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Abstract 

Slowly convergent series and sequences as well as divergent series occur quite frequently in 
the mathematical treatment of scientific problems. In this report, a large number of mainly 
nonlinear sequence transformations for the acceleration of convergence and the summation of 
divergent series are discussed. Some of the sequence transformations of this report as for instance 
Wynn's e algorithm or Levin's sequence transformation are well established in the literature on 
convergence acceleration, but the majority of them is new. Efficient algorithms for the evaluation 
of these transformations are derived. The theoretical properties of the sequence transformations in 
convergence acceleration and summation processes are analyzed. Finally, the performance of the 
sequence transformations of this report are tested by applying them to certain slowly convergent 
and divergent series, which are hopefully realistic models for a large part of the slowly convergent 
or divergent series that can occur in scientific problems and in applied mathematics. 
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1. Introduction 

1.1. Infinite series and their evaluation 

Infinite series are ubiquitous in the mathematical analysis of scientific problems. They naturally 
appear in the evaluation of integrals, in the solutions of differential and integral equations, or as 
Fourier series. They are also used for both the definition and the evaluation of many of the special 
functions of mathematical physics. The conventional approach for the evaluation of an infinite 
series consists in computing a finite sequence of partial sums 

n 

Sn = ^ak (1-1-1) 

A;=0 

by adding up one term after the other. Then, the magnitude of the truncation error is estimated. 
If the sequence of partial sums sq,. . . ,Sn has not converged yet to the desired accuracy, additional 
terms must be added until convergence has finally been achieved. With this approach it is at least 
in principle possible to determine the value of an infinite series as accurately as one likes provided 
that one is able to compute a sufficiently large number of terms accurately enough to overcome 
eventual numerical instabilities. 

However, in many scientific problems one will only be able to compute a relatively small number 
of terms. In addition, particularly the series terms with higher summation indices are often 
affected by serious inaccuracies which may lead to a catastrophic accumulation of round-off errors. 

Consequently, if an infinite series is to be evaluated by adding one term after the other, an 
infinite series will be of practical use only if it converges after a sufficiently small number of terms. 
Unfortunately, many counterexamples are known in which alternative methods for the evaluation 
of infinite series must be used since in these cases the conventional approach of evaluating an 
infinite series does not suffice. 

For instance, when Haywood and Morgan [1] performed a discrete basis-set calculation of the 
Bethe logarithm of the Is state of the hydrogen atom, they found that even 120 basis functions 
gave no more than 2-3 decimal digits and they estimated that approximately 10^° basis functions 
would be needed to obtain an accuracy of more than 10 decimal digits. Haywood and Morgan 
also showed that with the help of a suitable convergence acceleration method an accuracy of more 
than 13 decimal digits can be extracted from their data. 

A good mathematical model for the convergence problems which Haywood and Morgan [1] 
encountered in their calculation of the Bethe logarithm is the following series expansion for the 
Riemann zeta function: 

oo 

Ciz) = ^(n + ir- (1-1-2) 

n=0 

It is well known that this infinite series converges if Re{z) > 1 holds. However, if Re{z) is only 
slightly larger than one, the rate of convergence becomes extremely slow. For instance. Bender 
and Orszag remark in their book (see p. 379 of ref. [2]) that about lO^'^ terms of the above series 
expansion would be needed to compute C(l l) accurate to one percent. Bender and Orszag also 
show that only 10 terms of the series in connection with a specially designed acceleration method 
are needed to compute C(l-l) to 26 decimal digits (see table 8.7 on p. 380 of ref. [2]). 

Even more striking examples for the inadequacy of the conventional approach towards the 
evaluation of infinite series are some Rayleigh-Schrodinger perturbation expansions of elementary 
quantum mechanical systems. For instance, if the following normalization for the Hamiltonian of 
the quartic anharmonic oscillator is used. 



(1.1-3) 
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then it follows from the results obtained by Bender and Wu (see eq. (1.8) of ref. [3]) that the 
coefficients c„ of the power series in the coupling constant (3 for the ground state energy eigenvalue 
Eq{/3) of the quartic anharmonic oscillator, 

oo 

EoiP) = 5^ c„/3", (1.1-4) 

n=0 

possess the following asymptotic behaviour: 

c„ ~ (-l)"+^(3/2)"r(n + l/2), n^oo. (1.1-5) 

The radius of convergence of the above Rayleigh-Schrodingcr perturbation series is obviously 
zero, i.e., it diverges for all nonzero values of (3 and summation techniques have to be applied to 
give this series any meaning beyond a mere formal expansion. 

A good mathematical model for the kind of divergence, which occurs in the perturbation series 
of the quartic anharmonic oscillator, is the so-called Euler integral 

/•oo -t 

and its associated asymptotic series, the so-called Euler series 

oo 

E{z) - ^(-l)"nb" = 2i^o(l, 1; -^) , ^^0. (1.1-7) 

n=0 

The radius of convergence of the Euler series is obviously zero. Consequently, this series diverges 
quite wildly for all z 7^ and appropriate summation techniques have to be applied if numerical 
values for the Euler integral are to be computed with the help of this asymptotic series. In fact, 
the Euler series (1.1-7) will be used quite frequently in this report to test the ability of a sequence 
transformation to sum wildly divergent series. 



1.2. A short history of sequence transformations 

In this section, a short sketch of the historical development of sequence transformations will 
be given. A more complete treatment of the history would be beyond the scope of this report. 
Consequently, the emphasis will be on those developments which laid the foundations for the 
sequence transformations which are discussed in this report. 

The idea of applying suitable transformations for the acceleration of the convergence of a series 
or for the summation of a divergent series is almost as old as analysis itself. According to Knopp 
(see p. 249 of ref. [4]) the first series transformation was published by Stirling [5] already in 1730, 
and in 1755 Euler [6] published the series transformation which now bears his name. 

These early ideas were later extended and refined as well as supplemented by convergence proofs, 
and they finally led to the theory of regular matrix transformations. Let {[sn]} be a sequence of 
partial sums of a series according to eq. (1.1-1). Then, a new sequence {[sJi]} with hopefully better 
convergence is obtained by forming weighted means of the elements of the original sequence, 

n 

■Sn = XI l^rikSk- (1-2-1) 
A;=0 
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The main appeal of these matrix transformations lies in the fact that for the weights /i„fc 
with A;, n € E^O) which define such a transformation, some necessary and sufficient conditions 
could be formulated which ensure the regularity of the transformation. This implies that such a 
regular matrix transformation can safely be applied to any convergent sequence {[sn]} since the 
transformed sequence {[s^]} will also converge to the same limit. A fairly complete survey of the 
properties of such matrix transformations can be found in books by Knopp [4], Hardy [7], Petersen 
[8], Peyerimhoff [9], Zeller and Beekmann [10], and Powell and Shah [11]. 

This general applicability of regular matrix transformations to all convergent sequences is 
undoubtedly quite advantageous from a theoretical point of view. However, for the practical 
usefulness of a transformation in actual computations this general applicability is more likely a 
hindrance rather than an advantage. This may sound paradoxical. But one cannot realistically 
expect that a given method will be particularly efficient in a special case if it is simultaneously 
required that this method should also be able to work in all cases. 

Consequently, in recent years emphasis has shifted towards the more powerful but also more 
specialized nonlinear transformations. Theoretically, nonlinear transformations are much more 
complicated than matrix transformations and their properties are by no means completely un- 
derstood. In addition, nonlinear transformations are usually nonregular, i.e., it is not guaranteed 
that the transformed sequence {[s^]} will converge at all, let alone to the same limit as the original 
sequence {[s„]}. Hence, unless additional information about the sequence to be transformed is 
available, the use of a nonlinear sequence transformation may be risky. However, this undeniable 
disadvantage is compensated by the empirical fact that if a nonlinear transformation works, it 
frequently does so in a spectacular fashion. 

The probably oldest nonlinear sequence transformation is the famous process, 

4 = ^n-^=^n b±l^i!£_, rieJNo. (1.2-2) 

A^S„ Sn+2 - 2Sn+l + Sn 

This sequence transformation is named after Aitken [12] who published this transformation in 
1926 but there are indications that it is in fact much older. For instance, Todd (see p. 5 of ref. 
[13]) claims that this transformation was in principle already known to Kummer [14]. 

It is generally accepted that the current interest in nonlinear transformations is due to two 
articles by Shanks [15] and Wynn [16], respectively. Shanks rediscovered in 1955 a sequence 
transformation which was originally derived in 1941 by Schmidt [17]. Wynn showed only one 
year later how this sequence transformation, which was originally defined as the ratio of two 
determinants, can be computed quite efficiently by a nonlinear recursive scheme which is now 
commonly called the e algorithm. These two articles by Shanks [15] and Wynn [16] had an 
enormous impact since they stimulated a large amount of research not only in various branches of 
mathematics but also in theoretical physics and in other sciences. This is amply demonstrated by 
the long lists of references in books by Baker [18], Brezinski [19 - 21], Baker and Graves- Morris 
[22], and Wimp [23], and also by a recent review article by Brezinski [24]. 

This active research on nonlinear transformations contributed significantly not only to the 
understanding of Pade approximants or the e algorithm, but also led to the discovery of several 
other sequence transformations. For instance, in 1956 Wynn [25] introduced the so-called p 
algorithm which is essentially an intelligent and efficient way of computing and extrapolating 
even-order convergents of an interpolating continued fraction. 

In 1971 Brezinski [26] introduced his so-called algorithm which may be interpreted to be some 
kind of improved and accelerated e algorithm. Brezinski's derivation of this powerful algorithm was 
purely heuristic. It was emphasised by Brezinski [27] that this heuristic approach is not restricted 
to Wynn's e algorithm and can also be used in the case of other sequence transformations. Some 
examples of new sequence transformations, which were derived in that way, will be given later. 
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Another class of sequence transformations was introduced by Levin [28] in 1973. According to 
Smith and Ford [29,30] who compared the performances of several linear as well as nonlinear 
sequence transformations, some variants of the Levin transformation are probably the most 
powerful and most versatile convergence accelerators currently known and they are also able 
to sum even wildly divergent series. The sequence transformations introduced by Levin are also 
the basis of a large part of this article since they are the starting point for the derivation of several 
new sequence transformations which offer in some cases computational advantages, in particular 
if wildly divergent series are to be summed. In addition, a theoretical analysis of the properties 
of the new transformations can also often be done more easily than in the case of the Levin 
transformation. 

A general extrapolation algorithm, which encompasses the majority of the currently known 
extrapolation methods and also many of the new sequence transformations of this report as 
special cases, was developed independently by Brezinski [31] and Havie [32]. 

Finally, Germain-Bonne [33] developed in 1973 a formal theory of convergence acceleration 
which is of considerable importance not only for this report. By means of Germain-Bonne's 
theory it can in some cases be decided whether a given transformation is regular, i.e., whether 
the convergence of a sequence ^Sn^ to some limit s implies the convergence of the transformed 
sequence {[s^]} to the same limit s. Also, in some cases it can be decided by a priori considerations 
whether the transformed sequence {[s^]} will converge faster than the original sequence {[s„]}. 

1.3. Organization of this report 

No attempt is made to treat all aspects of the acceleration of convergence and the summation 
of divergent series. The emphasis of this report is on convergence acceleration and summation 
by means of nonlinear sequence transformations. Linear sequence transformations are only 
treated if they are special cases of nonlinear sequence transformations. The nonlinear sequence 
transformations, which occur in this report, are designed to handle convergent or divergent 
sequences of partial sums of infinite series as they occur in scientific applications or in the theory of 
special functions. However, the specific problems, which arise in connection with the acceleration 
of the convergence of Fourier series or of orthogonal expansions, are not treated. Also, the 
acceleration or summation of multidimensional sequences - or vector sequences, as they are called 
in the literature on convergence acceleration - is not considered in this report. 

Several nonlinear sequence transformations as for instance Aitken's process [12], Wynn's 
e algorithm [16], Wynn's p algorithm [25], Brezinski's algorithm [26], and Levin's sequence 
transformation [28] are now relatively well known and many applications of these transformations 
have been reported in the more recent literature. The properties of these nonlinear sequence 
transformations are reviewed shortly in this report and efficient algorithms for their computation 
are discussed. However, the emphasis of this report is on the derivation of new nonlinear sequence 
transformations, on the construction of efficient algorithms for their computation, and on the 
analysis of their properties in convergence acceleration and summation processes. 

In this report, the sequence transformations are always computed with the help of linear 
or nonlinear 2-dimensional recurrence formulas. Also, it is always tried to find computational 
schemes for these recursions which are optimal with respect to storage requirements. Such 
an optimization is actually not necessary if the sequence transformations are programmed in 
FORTRAN because then storage space would not be a problem even if less eflficient computational 
algorithms would be used. If, however, sequence transformations are programmed in a formal 
manipulation language such as REDUCE, MACSYMA or MAPLE, it is probably a good idea to 
use such an optimized computational scheme since storage restrictions may then be much more 
severe. 
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Some listings of FORTRAN 77 programs are included in the text. In order to save space, all 
comments and also all IF statements, which check the validity of the input data, were removed 
from the programs. Consequently, these FORTRAN 77 programs are not "good" programs 
which comply with the recommendations of books on programming style. The sole purpose 
of these program listings is to facilitate the understanding of the sometimes relatively intricate 
computational algorithms which are described in this report. 

In order to make this report more selfcontained, in section 2 the mathematical terminology, 
which is specific for this report, as well as the most important mathematical concepts and 
techniques, which are needed for the derivation and understanding of sequence transformations, 
are introduced. 

In section 3 general properties of nonlinear sequence transformations are discussed. In ad- 
dition, it has been attempted to give a motivation for some of the most important concepts 
and assumptions, which are the basis for the construction of a large class of nonlinear sequence 
transformations. 

Section 4 deals with Wynn's e algorithm [16], which is an efficient algorithm for the computation 
of the Shanks transformation [15] or - if the elements of the sequence to be accelerated or summed 
are the partial sums of a power series - of Fade approximants. Section 5 deals with Aitken's 
process [12] and its iteration, which arc both close relatives of Wynn's e algorithm. Section 6 deals 
with Wynn's p algorithm [25], which is structurally almost identical with Wynn's e algorithm. 

Also, a new sequence transformation is constructed by iterating the explicit expression for p)^^ 
along the lines of Aitken's iterated process. 

Section 7 deals with with Levin's sequence transformation [28], and several other sequence 
transformations which are either special cases or generalizations of Levin's sequence transforma- 
tion. Levin's sequence transformation is also the starting point for two new classes of sequence 
transformations which are treated in sections 8 and 9. The difference between Levin's sequence 
transformation and the new sequence transformations is that Levin's sequence transformation 
is based upon the assumption that the remainders of the partial sums can be approximated by 
truncated Poincare-type asymptotic expansions whereas the new sequence transformations assume 
that the remainders can be approximated by truncations of factorial series and related expansions 
which are also based upon Pochhammer symbols. 

Section 10 deals with Brezinski's d algorithm [26], which was derived by modifying the recursive 
scheme for Wynn's e algorithm, and a closely related sequence transformation which is obtained 

in) 

by iterating the expression for "d^ . In section 11, the recursive schemes of several other linear 
and nonlinear sequence transformations are modified along the lines of Brezinski's '& algorithm 
and several new nonlinear sequence transformations arc derived. 

The practical usefulness of the original version of Germain-Bonne's formal theory of convergence 
acceleration [33] is quite limited since it can only analyze the properties of a sequence transforma- 
tion if its recursive scheme satisfies some very restrictive conditions. Many sequence transforma- 
tions of this report do not satisfy these conditions. Consequently, in section 12 Germain-Bonne's 
formal theory of convergence acceleration is modified in such a way that the properties of the 
sequence transformations of this report can also be analyzed. 

Unfortunately, Germain-Bonne's theory cannot be applied in all cases of interest. In particular, 
it cannot be used for the analysis of the summation of wildly divergent Stieltjes series as they for 
instance occur in the Rayleigh-Schrodinger perturbation expansion for the energy eigenvalues of 
the quartic anharnionic oscillator. In section 13 the transformation of sequences of partial sums 
of convergent and divergent Stieltjes series is analyzed. The estimates, which are obtained in 
this way, indicate that some variants of the new sequence transformations, which are discussed 
in sections 8 and 9, should sum a divergent Stieltjes series as good or even somewhat better than 
the analogous variants of Levin's sequence transformation, and that they should all be far more 
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efficient than Pade approximants. These theoretical estimates are supported quite convincingly 
by some numerical examples. 

One of the most complicated computational problems, which can occur in this context, is the 
acceleration of the convergence of infinite series with terms that all have the same sign and that 
decay like a fixed power with Q;>lasn— >oo. A good example of such an extremely slowly 
convergent infinite series with positive terms is the series (1.1-2) for the Riemann ^ function. 
In the case of such slowly convergent series with positive terms, Germain-Bonne's formal theory 
of convergence acceleration [33] also does not help. Section 14 deals with the acceleration of 
the convergence of series of that type. Some exactness results and also some error estimates 
are derived. However, it is relatively difficult to obtain theoretical results. Consequently, the 
emphasis in section 14 is on numerical testing. 

Finally, section 15 contains a condensed review of the properties of the sequence transformations 
which are treated in this report. 
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2. Terminology 

2.1. Special mathematical symbols and special functions 

In this report, essentially standard mathematical terminology will be used. In particular, IN 
stands for the set of positive integers n = 1,2,3, .. ., and INq stands for the set of nonnegative 
integers n = 0, 1, 2, . . . . Also, IR and C denote the sets of real and complex numbers, respectively. 
The following notations are, however, nonstandard: 

{[s„]} : Sequence of elements ,s„ with n G INq. It is always tacitly assumed that the sequence 

elements with negative indices, s^2i S-s, . . ., are zero. 
[[a;| : Integral part of a; G IR, i.e., the largest integer m satisfying the inequality m < x. 
F" : Set of all vectors (xi, . . . G IR" with all components being different from zero, i.e., 

Xj 7^ for all j = 1, 2, . . . , n. 
ID" : Set of all vectors (zi, . . . , Xn) G IR" with all components being distinct, i.e., i ^ j implies 

Xi / Xj for alH, j = 1, 2, . . . , n. 
H" : Intersection of F" and D", i.e., the set of vectors {x\,. . . ,Xn) G IR" with all components 

being nonzero and distinct. 
Sometimes sums or products will occur in which the lower limit is greater than the upper limit. 
In this report, we shall always use the convention that such an empty sum will be interpreted as 
zero, i.e., 

n 

^ afc = 0, if m > n, (2-1-3) 

k=m 

and that such an empty product will be interpreted as one, i.e., 

n 

Ofc = 1, if m>n. (2-1-4) 

k=m 

For the commonly occurring special functions of mathematical physics the notation and the 
conventions of Magnus, Oberhettinger, and Soni [34] will be used in this report unless explicitly 
stated. 

2.2. Order symbols 

Let f{z) and g{z) be two functions defined on some domain D in the complex plane and let zo 
be a limit point of D, possibly the point at infinity. Then, 

f{z) = 0{9{z)) , z^zo (2.2-1) 

means that there is a positive constant A and a neighbourhood U of Zo such that 

\fiz)\ < A\g{z)\ (2.2-2) 

for ail z E U r\ D. If g(z) does not vanish on U HD this simply means that f{z)/g{z) is bounded 
onUnD. Also, 

f{z) = oig{z)) , z^zo (2.2-3) 
means that for any positive number e G IR there exists a neighbourhood U of zo such that 

1/(^)1 < e\g{z)\ (2.2-4) 

for all z eU r\D. If g{z) does not vanish onU r\D this simply means that f{z)/g{z) approaches 
zero as z ^ zq. 
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2.3. Asymptotic sequences and asymptotic expansions 

A finite or infinite sequence of functions •{[$„(z)]} with n € E^Oi which are defined on some 
domain D of complex numbers on which all $n(-2) are nonzero except possibly at zq, is called an 
asymptotic sequence as z ^ zq if, for all n G JNq, 

^n+l{z) = o{^n{z)), Z^Zo. (2.3-1) 

Examples for asymptotic sequences with n € JNq are {[(z — -Zq)"]} as z —>■ zq or {[(log z)^"]} as 
z ^ oo. 

The formal series 

oo 

f{z) ~ Yl ^^"(^) ' (2.3-2) 

n=0 

which need not be convergent, is called an asymptotic expansion of f{z) with respect to the 
asymptotic sequence •{[^n(-2)]} in the sense of Poincare if, for every m € INq, 

m 

f{z)-Y Cn<^n{z) = 0{<^„^{Z)), Z ^ Zo . (2.3-3) 
n=0 

If such a Poincare-type asymptotic expansion exists, it is unique, and its coefficients c„ can be 
computed recursively, 

m— 1 

= lim I [f{z) - V Cn<^niz)] / <^m{z)} , m G INq . (2.3-4) 
n=0 

The first term of the asymptotic expansion (2.3-2) is usually called the dominant or leading 
term and one frequently writes 

fiz) ~ Mz), (2.3-5) 

indicating that f{z)/^o{z) tends to cq as z — ^ zq. 

A particularly simple asymptotic sequence as z ^ oo is the set •{[^'(z)/^"']}, n G INq, with "^{z) 
being a suitable function. If a given function f{z) possesses an asymptotic expansion with respect 
to this sequence, 

oo 

f{z) ~ *(z) Cn/z'' , Z ^ OO , (2.3-6) 

n=0 

then the ratio f{z)/'^{z) can be expressed as an asymptotic power series in 1/z, 

oo 

/(z)/*(z) ~ ^ c,/z" , z^oo. (2.3-7) 

n=0 
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2.4. Finite differences 

Let / be a function defined on the set of integers JNq. Then, the forward difference A/(n) is 
defined by the relationship 

A/(n) = /(n + 1) - /(n), n G INq . (2.4-1) 

Higher powers of the difference operator A can be defined recursively, i.e., 

AV(n) = A[A'^-V(n)] , fc G IN, (2.4-2) 
AV(n) = fin) . (2.4-3) 

The shift operator E is defined by the relationship 

Ef{n) = /(n+1). (2.4-4) 

Higher powers of E can again be defined recursively. Obviously, we have 

E^fin) = f{n + k), keJN, (2.4-5) 
^V(n) = fin) . (2.4-6) 

It follows at once from their definitions that the operators A and E are connected by the 
relationship 

A = E-1. (2.4-7) 
This relationship can be combined with the binomial theorem to give 

AV(n) = (-l)^^(-l)^Y^)/(n + j), kelNo. (2.4-8) 

In the following text it will always be tacitly assumed that in the case of several indices the 
difference operator A and the shift operator E will only act upon n and not on other indices. 

2.5. Special sequences 

Let us assume that the sequence {[s„]} either converges to some limit s, or, if it diverges, can be 
summed by an appropriate summation method to give s. In the case of divergence s is frequently 
called antilimit. Then, the partition of a sequence element s„ into the limit or antilimit s and the 
remainder rn according to 

Sn = s + rn (2-5-1) 
makes sense for all n G INq. If s„ is the partial sum of a series, 

n 

Sn = ^ Ofe , (2.5-2) 
k=0 

the remainder r„ obviously satisfies 

oo 

r„ = - ^ Ofc. (2.5-3) 

k=n+l 
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For the ratio of two consecutive terms of an infinite series we write 

Pn = o„+i/a„, n G INTo . (2-5-4) 

The magnitude of the remainder r„ is a natural measure for the convergence of a sequence or 
series. Often, it is also of considerable interest to analyze the asymptotics of the sequence of 
remainders {[rn]} as n ^ oo. Let {[(^^(n)]}, k G INq, be a suitable asymptotic sequence as n — >■ oo 
with ipQ{n) = 1. Then, a;„ denotes the dominant part of r„ with respect to the asymptotic 
sequence (pk{n), i.e., 

oo 

rn/i^n ~ XI ^k^Pkin), n^oo. (2.5-5) 

fc=0 

Sequences of remainder estimates will be of considerable importance in this report. 

The reason is that it is often possible to obtain at least some structural information about the 
behaviour of the dominant term of a remainder as n — ^ oo. It will become clear later that 
those convergence acceleration or summation methods, which explicitly utilize the information 
contained in the remainder estimates {[a;„]}, are frequently particularly efficient. 

Many sequence transformations do not only require the input of the sequences {[sn]} and {[wn]} 
but also the input of an additional sequence of auxiliary quantities as for instance interpolation 
points. In this report, such an auxiliary sequence will usually be denoted by -{[x„]|. 

2.6. Types of convergence 

It is neither possible nor desirable to set up a complete classification scheme which is able to 
cover all types of convergence. However, in the majority of all practical applications only a few 
types of convergence occur. Consequently, special names were given to them in the literature. 

Let us assume that the sequence {[sn]}, which converges to some limit s, satisfies 

lim f!l±l^ = = p. (2.6-1) 

n— ♦oo Sn — S n— »oo 

If < IpI < 1 holds, we say that the sequence {[sn]} converges linearly, if /9 = 1 holds, we say 
that converges logarithmically, and if p = holds, we say that -Jsn]} converges hyperlinearly. 
Of course, \p\ > 1 implies that the sequence {[sn]} diverges. 

The standard example for linear convergence is the sequence of partial sums of the geometric 
series, 

n ^ n+1 

Sn{z) = X z*^ = , < 1^1 < 1 , n G INo . (2.6-2) 

k=0 ^ 

The sequence of partial sums of the scries (1.1-2) for the Riemann zeta function is a good 
example for logarithmic convergence. Also, it can be shown quite easily that the partial sums of 
the power series for the exponential function form a sequence which converges hyperlinearly. 

The above definitions for hyperlinear, linear and logarithmic convergence do not seem to be 
particularly well suited for the classification of infinite series because normally only the terms 
of a series but not the remainders r„ are known. However, Wimp showed on p. 6 of his book [23] 
that if < IpI < 1 holds, the two statements 

lim (r„+i/r„) = p (2.6-3) 



and 



lim (a„+i/a„) = p 

n— »oo 



(2.6-4) 
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are equivalent. In addition, Clark, Gray, and Adams [35] showed that if the terms of a 
convergent series are all real and have the same sign, then 

lim {vn+i/rn) = lim (a„+i/a„) = p. (2.6-5) 

n— ♦oo n— >oo 

In eq. (2.6-5), the case p = 1, which corresponds to logarithmic convergence, is not excluded. 
Hence, it is at least possible to classify linearly and logarithmically convergent series - which 
are of particular interest in connection with convergence acceleration methods - according to the 
behaviour of their terms as n — > oo. 

Sequences and series, which converge hyperlinearly, often converge so rapidly that not much can 
be gained by convergence acceleration methods. Consequently, hyperlinear convergence is more or 
less neglected in the literature on convergence acceleration. This is not entirely justified because in 
some situations the use of convergence acceleration methods can indeed be quite helpful. A simple 
and nevertheless striking example, which shows that convergence acceleration methods may be 
quite useful even in the case of hyperlinear convergence, is the power series for the exponential 
function. It cannot be used for the computation of e~^ if x is positive and large because then 
large terms with alternating signs would lead to cancellation and to severe numerical instabilities. 
However, if suitable convergence acceleration methods are used, remarkably accurate results can 
be obtained after a relatively small number of terms. 

Let us assume that two sequences {[s„]} and {[s^]} both converge to the same limit s. We shall 
say that the sequence {[s^]} converges more rapidly than {[sn]} if 

lim = 0. (2.6-6) 

n— ►oo Sji — S 

In convergence acceleration processes, this definition is somewhat inconvenient since it requires 
the knowledge of the limit s which is usually not known. Consequently, it would be desirable to 
replace eq. (2.6-6) by the alternative condition 

lim ^^+^ ~ ^" = lim ^ = 0. (2.6-7) 

n^oo Sn+\ — Sn n— >oo As„ 

However, it seems that it is not possible to prove the equivalence of eqs. (2.6-6) and (2.6-7) 
without making explicit assumptions about how fast the sequences {[s„]} and {[s^]} approach their 
common limit s. 

If the sequence converges linearly, the transformed sequence {[s^]} can only converge more 
rapidly than {[sn]} if it converges at least linearly or even faster. In this case, the equivalence of 
the two conditions (2.6-6) and (2.6-7) follows at once from the relationship 

S'n+l - S'n ^ S'n-S -«)/«- s)] - 1 

- Sn Sn- S [(s„+i - s) / (s„ - s)] - 1 

However, if {[s„]} converges logarithmically, the denominator of the second term on the right- 
hand side of eq. (2.6-8) approaches zero as — > oo. In this case, some additional assumptions 
about the rate of convergence of {[s^]} to s have to be made in order to be able to show that the 
two conditions (2.6-6) and (2.6-7) are indeed equivalent. 



(2.6-8) 
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2.7. Sequence transformations 

In this report a sequence transformation T will always be a rule which transforms a given 
sequence {[sn]} into a new sequence {[s^]}, 



r ■■ W\ ^ is'J , n G INo . 



(2.7-1) 



Since a computational algorithm can only involve a finite number of operations, only finite 
subsets of a sequence {[sn]} can be associated to a new sequence element s'^ by a sequence 
transformation T. In addition, it will always be assumed that the finite subset, which is to 
be transformed, will entirely consist of consecutive elements. This means that only subsets of the 
type {sn,Sn+i, ■ ■ ■ , with n,i (z INq will be considered. Since the subsets, which are to be 

transformed, contain £ + 1 elements, i will frequently be called the order of the transformation 
T. Hence, if all elements of the sequence ^s^^ are real and if no sequences of interpolation points 
or remainder estimates •{[a;„]| are needed, a sequence transformation T of order ^ is a map 
of the following type: 

r : ]R^+^ ^ IR . (2.7-2) 
In this report, a sequence transformation T can always be represented by an infinite set of 

(n) 

doubly indexed quantities with k,n € INq. The superscript n always indicates the minimal 
index occurring in the finite subset of sequence elements which are used for the computation of 



the transform T^"^-* , and the subscript A; is a measure for the complexity of such a Tj^ 

(n) (n) 

The quantities ' are gauged in such a way that Tq will always correspond to an untrans- 
formed sequence element, i.e., 

(2.7-3) 



.(n) 



n G 1N| 







(n) 

Increasing values of k imply that the order i of the transform also increases. This means 
that for every k,n £ INq the sequence transformation T will produce a new transform for which 
we shall write 



n+l) 



, Sn+e) 



(2.7-4) 



Here, the order i is of course a function of k. The exact relationship, which connects the 

subscript k and the order i, is specific for every sequence transformation T. In this report we 
shall encounter a variety of different relationships such as i = k, i = k + 1, £ = 2k oi even i = 3k. 

(n) 

The transforms Tf' with k,ne'5No can be displayed in a 2-dimensional array which is called 

the table of the sequence transformation T. In this report, the transforms T^""^ will always be 

ordered in a rectangular scheme in such a way that the superscript n indicates the row and the 
subscript k the column of the array. Hence, in this report the table of a transformation T will 
always be displayed in the following way: 



■^(0) ^(0) 



■■0 



1 



.(1) ^(1) 



■■0 



-1 



r(3) 



.(0) 

2 

.(1) 
2 

.(2) 



.(0) 



.(1) 



T'V- 
n 



(2) 



7^(3) ^(3) 
-'I -^2 



T'V' 
n 



(3) 



(2.7-5) 



-,(n) rrin) 



'■0 



1 



In the process of convergence acceleration or summation only those elements of the table of a 
sequence transformation T should be computed which will be needed to obtain convergence up 
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to a certain accuracy. Of course, this implies that one has to decide in advance which transforms 

(n) 

' should be used for that purpose. In this context it will be advantageous to introduce the 
following terminology. 

A sequence {[(nj, fcj)]} of ordered pairs of integers n^, kj € INq is called a yath if no = /^o = 
and if for all integers j G Mo we have nj+i > rij and fcj+i > kj and if for each j G Wq either one 
or both of the two relations n^+i = + 1 and fcj+i = fcj + 1 are true. Obviously, Uj + fcj — > oo 

as j — > oo. 

Paths where kj is ultimately constant are called vertical paths, and paths where rij is ultimately 
constant are called horizontal paths. 

We shall say that a sequence transformation T is regular on a given path V = ^{rij, %)][ if for 
every convergent sequence {[sn]} we have 

lim T^"^'^ = s. (2.7-6) 

Next, we want to define what we mean by saying that a transformation T is called accelerative 
on a path V for a sequence {[sn]}- In the literature on convergence acceleration the following 
definition is the most common one: 

lim = 0. (2.7-7) 

j^oo Srij — S 

However, since for a given subscript k a sequence transformation T always acts on ^ -|- 1 
consecutive sequence elements s„,s„+i, . . . ,Sn+^ with i being a function of /c, it would actually 
be better to say that T is accelerative on a path V for a sequence -{[sn]| if 

_ g 

lim = 0. (2.7-8) 

j^oo Sn.+l- - S 

Hence, if the second definition is used a transformation T will be called accelerative on a path 
V = {[(n-j, fcj)]} if the transforms T^"'-' converge faster than the last elements s^j+e^ of the strings 

' (n) 
Sriji Suj+i^ ■ ■ 1 ^Uj+ij which are used for the computation of the transforms T^^. ■ 

In this report both definitions (2.7-7) and (2.7-8) will be used. However, it will always be stated 
explicitly which of the two different definitions is actually meant. 

Let us again assume that a sequence {[s„]} converges to some limit s. A sequence transformation 
T will be called exact for the sequence {[5^]} if some integer £0 £ ^0 exists such that the application 
of T to every finite string s„, . . . , s„+^ of sequence elements with ^ > yields the exact limit s 
of this sequence. 
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3. On the derivation of sequence transformations 

3.1. General properties of nonlinear sequence transformations 

It was remarked earlier that in many cases of physical interest the conventional approach of 
evaluating an infinite series by adding one term after the other does not suffice. Examples are 
logarithmically convergent series which may converge so slowly that an evaluation by adding one 
term after the other would overstep even the potential of modern supercomputers, or divergent 
series as they for instance occur in Rayleigh-Schrodingcr perturbation theory. 

In such cases it is necessary to replace the conventional process of evaluating a series by a 
generalized summation process which is able to associate a numerical value even to a prohibitively 
slowly convergent or divergent series. 

The generalized summation processes of this report are transformations which are defined on 
finite subsets of the sequence {[s^]} of partial sums. Let be such a generalized summation 
process which acts upon i + 1 partial sums s„, . . . , Sn+e- In view of the fact that in the case of 
convergent series with real terms we have 

oo oo oo 

^ (aan + /3bn) = a'^ an + /3'^ bn , q;,/3gIR, (3-1-1) 

n=0 n=0 n=0 

it seems natural to require that such a generalized summation process % should also be linear. 
Therefore, let us assume that and {[tn]} are two sequences of partial sums of real terms which 
converge to s and t, respectively. Thus, a generalized summation process 7^ should satisfy 

T£{asn + (3tn, ■ ■ ■ ,asn+e + Ptn+e) = ocTi{sn, ■ ■ ■ , Sn+e) + l3'^eitn,---,tn+e), 
a,/3GlR, ^,nG]No. (3-1-2) 

Also, such a generalized summation process should preserve the limit of a convergent sequence, 
i.e., it should be regular. Hence, a linear and regular generalized summation process 7^ should 
satisfy for all sequences {[sn]} and which converge to s and t, respectively, 

lim Ti{asn + (3tn, . . . , asn+e + (3tn+e) = as + pt. (3.1-3) 

n— >oo 

Unfortunately, the generalized summation processes considered in this report will in general 
be neither linear nor regular and we have to content ourselves with a weaker requirement. Let 

be a sequence and let a and r be two constants. We may only assume that a generalized 
summation process is invariant under translation, i.e., that for all admissible i,n & INq 

Ti{asn + T,. . . ,aSn+e + T) = aTi{sn, ■ ■ ■ , Sn+e) + T. (3-1-4) 

It must be emphasized that because of the nonregularity of the generalized summation processes 
of this report we also cannot assume that either 

lim Ti{sn, - - - , Sn+e) = s (3.1-5) 

n— >oo 

or - if this limit is defined - that 

lim Ti{sn, Sn+e) = s (3.1-6) 

♦oo 

holds for arbitrary convergent sequences 

Nonlinearity and nonregularity arc undeniably unpleasant complications which one would like 
to avoid instinctively. However, they are essential and indispensable since the power of the 
sequence transformations, which are discussed in this report, stems from their nonlinearity and 
nonregularity. 
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3.2. An example: Convergence acceleration of alternating series 

If we want to construct a generalized summation process, which is able to accelerate the 
convergence of an infinite series, we are confronted with the practical problem that the information 
contained in a finite string of partial sums sq, si, . . . , Sm has to be extracted and utilized in a way 
which is more efficient than the conventional process of adding up one term after the other. If we 
again assume that for all n € IMq a sequence element Sn can be partitioned into the limit s and 
the remainder r„ according to 

Sn = S + Vn, (3.2-1) 

then this essentially means that we have to find a way of eliminating the remainder r„ and 
determining the limit s at least approximately by exploiting the information stored in the finite 
string Sq, si, . . . , Sm of partial sums. 

Essentially the same problem of eliminating the remainder r„ and determining the antilimit s 
at least approximately arises if we try to sum a divergent series. The only difference is that in 
the case of a divergent series the remainder r„ does not vanish as n — > cx3, and that the antilimit 
s cannot be obtained by simply adding up the terms of the series. Instead, the antilimit s of a 
sequence can only be determined with the help of a suitable summation method. 

Since we cannot assume that it will be possible to obtain the numerical values of the remainders 
r„ directly, the best we can hope for is something which may be called structural information. In 
order to clarify this concept we will consider a simple example. Let us assume that the sequence 
elements s„ are partial sums of a series with real and strictly alternating terms, 

n 

s„ = 5](-l)^6fe, (3.2-2) 

k=0 

which means that all 6„ with n G INq have the same sign. The remainder r„ of s„ is then given 

by 

oo 

rn = - i-^fh- (3-2-3) 

k=n+l 

Let us now also assume that all 6„ with n G INq are positive and strictly decreasing with 
increasing n and that they vanish as n ^ oo. This implies that the series converges to some limit 
s. In addition, it can be shown that the sequence of remainders \rn^ is also strictly alternating 
and that the magnitude of a remainder r„ is bounded by the first term which was not included 
in the partial sum s„ (see p. 259 of ref. [4]), 

|r„|<6„+i, nGMo. (3.2-4) 

Now, we have to find a way of utilizing this structural information about the behaviour of 
the sequence of remainders {[r„]}. Simply adding the next term {—ly-^^bn+i to s„ would only 
produce Sn+i and we would not gain anything substantial. Consequently, we need an additional 
assumption which will help us to construct a sequence transformation for alternating series. 

It is a relatively natural idea to assume that the ratio r„/[(— l)"+"'^6„_|_i] can be expanded in a 
Poincare-type asymptotic power series in the variable l/(n + 1), i.e., 

oo 

rn ~ {-iT+^hn+i J2 + 1)"' ' n^oc. (3.2-5) 

j=0 

The assumption, that such a Poincare-type asymptotic expansion exists, will enable us to derive 
a sequence transformation which is capable of accelerating the convergence of alternating series. 
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However, the complete elimination of such a remainder r„ on the basis of the asymptotic 
expansion (3.2-5) will not be possible since any computational algorithm can only determine a 
finite number of the unknown linear coefficients Cj in eq. (3.2-5). Consequently, we can only 
construct a sequence transformation which is able to eliminate model remainders of the following 
type: 

k-1 

fn = (-l)"+'6„+i Yl (n + 1)-' , n G INo . (3.2-6) 

j=0 

Model remainders of this type are obtained by truncating the infinite series in eq. (3.2-5) after 
the first k terms. Hence, at least for sufficiently large values of k and n the model remainders f„ 
should approximate the actual remainders rn very well. This implies that the partial sums s„ can 
also be approximated very well by the elements of the following model sequence, which contain 
only finitely many terms: 

k-1 

Sn = s + (-l)"+i6„+i ^ Cj (n + 1)-^' , n G INo . (3.2-7) 

j=0 

In eq. (3.2-7) there occur k + 1 unknowns, the limit s and the k coefficients cq, . . . , c^-i- Since 
all unknowns occur linearly their determination poses in principle no problems. All that is needed 
are the numerical values of A; + 1 sequence elements, e.g., the string Sn, Sn+i, ■ ■ ■ , Sn+fe, and it is 
possible to determine the limit s of the model sequence (3.2-7). 

Hence, we only have to use Cramer's rule in order to see that the limit s is given by the following 
ratio of determinants: 



{-ir+'bn+i . 


■ ( 


^n+k 
-ir+'^+'bn+k+l 


i-ir+'bn+i 


( 


-ir+'^+'bn+k+i 


(n-M)^-i 




(n + k+l)''-'^ 


1 




1 


i-ir+'bn+i . 


■ ( 


-ir+'^+^br.+k+l 


i-ir+'X+i 


( 


-l)"+^'+i6„+fe+i 


(n-M)^-i 




{n + k + 1)^=-! 



(3.2-8) 



Now we could try to replace the elements s„ of the model sequence (3.2-7) in the first determi- 
nant in eq. (3.2-8) by the partial sums Sji- This would certainly not produce the exact limit s of 
the alternating series since the partial sums Sn satisfy eq. (3.2-7) only approximately. However, 
if the sequence elements .s„ arc able to approximate the partial sums .s„ with sufficient accuracy 
then we can hope that the ratio of determinants, in which now the partial sums s„, Sn+i, ■ ■ ■ , Sn+fc 
occur, will be a better approximation to the limit s than the last partial sum Sn+k which occurs 
in the ratio of determinants. 

We shall sec later that this is indeed the case. Actually, with the help of our simple arguments 
we found the determinantal representation of the sequence transformation d^^\j3, s„) with [5 = 1. 
This transformation, which will be defined later in eq. (7.3-9), is a special case of a very 
powerful sequence transformation which was introduced by Levin [28]. Levin's general sequence 
transformation and its numerous variants are discussed quite extensively in section 7 of this report. 
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In section 13 it is also shown that d^^\p,Sn), eq. (7.3-9), is able to sum even wildly divergent 
series and to accelerate the convergence of linearly convergent series. 

Our approach did not lead to a representation of this sequence transformation d^^\p,Sn), eq. 
(7.3-9), which is completely satisfactory from a computational point of view. Dctcrniinantal 
representations of sequence transformations are computationally quite unattractive since the 
reliable and economical evaluation of determinants is a more or less unsolved problem of numerical 
mathematics. Consequently, it is important to find other methods for the computation of a 
sequence transformation. In section 7, it will be shown how the determinantal representation 
(3.2-8) can be replaced by other representations which are better suited for numerical work. 
However, the concepts and principles, which will be used for the derivation of a large part of the 
sequence transformations of this report, should now be clear. They can be summarized as follows: 

(1) : Consider a model sequence with elements = s + f„ and assume that their remainders 
r„ can be partitioned into a remainder estimate lo^ multiplied by some other quantity z^- This 
implies that the elements s„ of the model sequence satisfy: 

Sn = S + LVnZn, n G INq . (3.2-9) 

(2) : Assume that an operator T , which is defined on finite subsets of sequences and which is 
linear, annihilates the quantities Zn defined in eq. (3.2-9), i.e., T{zn) = 0. If we rewrite eq. (3.2-9) 
in the following way 

{Sn - s)/uJn = Zn , (3.2-10) 

wc sec that ujn), which is exact for the model sequence eq. (3.2-9), 

i.e., which satisfies T(sn,iOn) = s, is given by the following ratio: 

nsn,cOn) = (3.2-11) 

(3) : Replace the elements Sn of the model sequence (3.2-9) in the expression defining the sequence 
transformation T{sn,uJn) ^ in this report either the ratio of two determinants, an explicit expres- 
sion, or a recursive scheme - by the elements of the sequence {[sn]} which is to be transformed. 

The crucial step in this approach is the choice of an appropriate sequence of model remainders 
{[ffj]} since the f„ should have a mathematical structure which permits the construction of a 
manageable annihilation operator T. In addition, the f„ should also be capable of producing 
good approximations for remainders r„ which occur in actual problems, because only then we 
may hope that the sequence of transforms will converge more rapidly than the original sequence 
These aims are usually accomplished by partitioning f„ into a remainder estimate cOn 
multiplied by a finite sum, 

m 

rn = ^ Cj (fjin) , m,n G INo . (3.2-12) 

j=0 

Here, the ^tpj (n)]} with j, n G INq are a suitable set of functions - usually an asymptotic sequence 
as for instance (n + 1)"-^ with j, n G INq - for which a sufficiently simple annihilation operator 
can be found and the Cj are so far completely unspecified coefficients which are responsible for 
the flexibility of this ansatz. 

Once the asymptotic sequence \ipj (n)]} is chosen, the crucial problem is the determination of a 
suitable sequence of remainder estimates {[wn]}- 

Although it may not be obvious at first sight, the determinantal expression (3.2-8) is exactly 
of the form of eq. (3.2-11). To see this, one only has to divide both determinants in eq. (3.2-8) 
by the product (-l)"+i6„+i • • • (-l)"+'=+i6„+fc+i. 
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For the sake of simplicity no distinction between the elements of a model sequence {[sn]} and 
the elements of a sequence {[sn]}; which is to be transformed, will be made from here on. This 
means that if a sequence transformation is constructed on the basis of a model sequence, then in 
the explicit expression or the recursive scheme, which defines this transformation, the sequence 
elements s„ and not the elements s„ of the model sequence will occur. 



3.3. The general extrapolation algorithm by Brezinski and Havie 

It is a typical feature of a large part of the modern nonlinear sequence transformations that 

they are by construction exact for special model sequences. The most general ansatz described 
in the literature was introduced independently by Brezinski [31] and Havie [32]. They assume a 
model sequence of the following type: 

k-l 

Sn = s + ^ /j(n), fc, n G INo . (3.3-1) 

3=0 

Concerning the set {[/j(n)]| with j, n € INq it is assumed that the fj{n) are known functions of 
n, but otherwise, they are essentially completely arbitrary. Hence, the ansatz (3.3-1) incorporates 
convergent as well as divergent sequences, depending upon the behaviour of the functions fjiji) 

as n ^ oo. 

In eq. (3.3-1), there occur k + 1 unknowns, the limit or antilimit s and the k coefficients 
Co, . . . ,Ci;_i. Since all the unknowns in eq. (3.3-1) occur linearly, the numerical values oi k + 1 
sequence elements s^, s^+i, • • • , Sn+fe have to be known in order to be able to determine the limit 
or antilimit s with the help of Cramer's rule. Consequently, the general extrapolation algorithm 
Ek{sn) by Brezinski and Havie, which is by design exact for sequences of the type of eq. (3.3-1), 
can be formulated as the ratio of two determinants. 







/o(n) . 


• fo{n + k) 


fk-lin) . 


. fk-i{n + k) 


1 


1 


/o(n) . 


■ Mn + k) 


fk-i{n) . 


■ fk-i{n + k) 



(3.3-2) 



Brezinski and Havie were also able to derive a recursive scheme for the computation of the 
transforms Ek{sn), which is, however, relatively complicated. A description of a FORTRAN IV 
program, which computes the transforms Ek{sn) via this recursive scheme, can be found in ref. 
[36]. 

Brezinski [31] showed that the general extrapolation algorithm Ek{sn) contains the majority 
of the currently known sequence transformations as special cases, among them Levin's sequence 
transformation [28]. It will be seen later that many of the new sequence transformations, which 
will be discussed in this report, are actually special cases of the general extrapolation algorithm 

EkiSn)- 

Consequently, it may seem that it is sufficient to consider only the general extrapolation 
algorithm Ek{sn) and not its numerous special cases. However, the complicated structure of 
its recursive scheme [31,32,36] makes the general extrapolation algorithm Ek{sn) computationally 
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much less efficient than its special cases. Of considerable importance is also the following aspect: 
In practical applications it is certainly helpful to know that for arbitrary functions fj{n) the 
sequence transformation Ek{sn) can be computed recursively. But it is clearly of greater practical 
relevance to find out which set ■{[/j(ra)]} produces the best results for a given sequence {[sn]}. 
Questions of that kind can only be answered by studying special transformations and by exploiting 
their specific properties. 

3.4. Iterated sequence transformations 

In section 3.3, it was mentioned that a large part of the modern nonlinear sequence transfor- 
mations are constructed in such a way that they are exact for certain model sequences. However, 
it is also possible to find new sequence transformations which are not constructed on the basis of 
model sequences. 

Let us assume that a sequence is to be transformed by a sequence transformation T^"^ 

with fc, n G INq and that for some k G IN, which is usually a relatively small number, a transform 

(n) 

Tk can be expressed explicitly in terms of the sequence elements s„, s„+i, . . . , s^+a, i-e., 

ri'*) = F(s„,s„+i,...,s„+a)- (3.4-1) 

Then, a new sequence transformation 0^"^ can be obtained by iterating the expression for Tji'\ 
This means that we define 

©S"^ = s„ , n G INo , (3.4-2) 
and that eq. (3.4-1) is rewritten in the following way: 

= (©S"^ , 0^"+'^ , . . . , , n G INo . (3.4-3) 

This relationship can now be used to construct a recursive scheme by means of which the 

in) 

transforms 0^ ' with k > 2 can be computed. One simple possibility of obtaining a recursive 
scheme would be to assume that eq. (3.4-3) corresponds to the special case A; = of the following, 
more general recursive scheme: 

©gi = Fk (©i") , , . . . , , fc, n G INo . (3.4-4) 

Later, we shall encounter several very powerful sequence transformations which are derived 
by iterating explicit expressions for other sequence transformations. A well known example is 
Aitken's iterated process which is obtained by iterating the explicit expression for Aitken's 
process, eq. (1.2-2). Interestingly, it often happens that the properties of the new sequence 
transformation differ significantly from the properties of the transformation from which it was 
derived. 
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4. The epsilon algorithm and related topics 

4.1. The Shanks transformation 

In his article on nonlinear sequence transformations Shanks [15] considered the following model 
sequence: 

Sn = S + ^ Cj ASn+j , n G INq . (4.1-1) 

j=0 

If the sequence elements Sn are partial sums of an infinite series, 



(4.1-2) 



i/=0 



the above model sequence can also be rewritten in the following way: 



fc-1 



j=0 



(4.1-3) 



Essentially this means that the limit s of the infinite series is approximated by the partial sum 
Sn plus a weighted sum of the next k terms an+i,an+2, ■ ■ ■ , On+fc- As in the previous examples the 
model sequence s„ contains A; + 1 unknowns - the limit or antilimit ,s and the k linear coefficients 
Co, . . . ,Cfe_i - which all occur linearly. Consequently, according to Cramer's rule the sequence 
transformation efc(s„), which is by construction exact for the model sequence (4.1-1), can be 
defined by the following ratio of determinants: 



efc(Sn) 





Sn+k 


ASn 




^Sn+k-1 ■ 


■ ■^Sn+2fc-l 


1 


1 


Asn 


•^•Sn+fc 


^Sn+k-1 ■ 


■ As„_|_2fc_l 



(4.1-4) 



For the computation of the transform efc(s„) the sequence elements Sn, ■ ■ ■ , Sn+2k are needed. 
This implies that efe(s„) is a transformation of order 2k. 

The sequence transformation ek{sn) is a special case of the general extrapolation algorithm 
Ek{sn) introduced by Brezinski [31] and Havie [32]. To see this we only have to replace fj{n) in 
eq. (3.3-2) by Asn+j- The transformation (4.1-4) was originally introduced in 1941 by Schmidt 
[17] who used it for the iterative solution of linear systems. In 1955 it was rediscovered by Shanks 
[15] who also analyzed some of the mathematical properties of the sequence transformation c^. (s^) 
and derived several interesting results. For instance, he was able to show that this transformation 
is also exact for model sequences with remainders that are sums of exponentials: 



fc-1 



(4.1-5) 
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Concerning the Xj it is assumed that they are ordered in such a way that their magnitudes are 
strictly decreasing, i.e., 

|Ao| > |Ai| > ••• > |Afc_i|. (4.1-6) 

If the condition [AqI < 1 is satisfied the model sequence (4.1-5) converges. In analogy with so- 
called physical transients, which disappear after a sufficiently long time. Shanks called the terms 
on the right-hand side of eq. (4.1-5) mathematical transients since all Aj" with |Aj| < 1 vanish as 
n oo. However, this concept of a mathematical transient has to be used here in a broader sense 
since the Shanks transformation efe(s„) can also be used for the summation of divergent sequences 
and series. The model sequence (4.1-5) diverges if at least one of the Xj satisfies |Afc| > 1, because 
then such a term XjP will not vanish as n — >■ oo. 

Shanks [15] also showed that the transformation efe(s„) and Pade approximants are closely 
related. Let us assume that f{z) is analytic in a neighbourhood of z = 0, 

oo 

f{z) = ^a,z-'. (4.1-7) 

i/=0 

Following the notation of Baker and Graves-Morris [22] we say that the Pade approximant of 
f{z) is the ratio of two polynomials pe{z) and qm{z) of degrees i and m, respectively, and write 

[£ / m]f {z) = pi{z) I 

Qm (^ 

). (4.1-8) 

The Pade approximants [£ / m] with i,m & IMq are displayed in a 2-dimensional rectangular 
scheme called the Pade table in such a way that the first index i indicates the column and the 
second index m the row of the array. The coefficients of the two polynomials pe{z) and qm{z) are 
defined by the relationship 

f{z) - pe{z)/qm{z) = 0{z'+^+'). (4.1-9) 

This implies that the coefficients of the Taylor expansion of the Pade approximant Pi{z) / Qmiz) 
have to agree with the series coefficients aj- up to the coefficient a^+m- Let fn{z) stand for a 
partial sum of the power series (4.1-7), 

n 

fn{z) = a.z'^. (4.1-10) 

iy=0 

Shanks [15] could show that the application of his transformation to the sequence {[/n(-2)]| 
produces the following elements of the Pade table: 

Ckifniz)) = [n + k / k]f (z) , k,nelNo. (4.1-11) 



4.2. Wynn's epsilon algorithm 

As it stands, the Shanks transformation efe(sn), eq. (4.1-4), is not particularly useful because of 
its definition as the ratio of two determinants. Fortunately, only one year after the publication of 
Shanks' article [15] Wynn [16] found a nonlinear recursive scheme which is now commonly called 
the e algorithm: 

e^-l = , e(") = , (4.2-la) 

4i = + l/[4"^'^ - 4"^] > A:, n G INo . (4.2-lb) 
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Wynn [16] was able to show that the elements of the e table with even subscripts give the 
Shanks transformation, 

4? = ^k{sn), k,n eJNo, (4.2-2) 
whereas the elements of the e table with odd subscripts are only auxiliary quantities satisfying 

4fcli = Vefe(Asn) , k,neNo. (4.2-3) 

The publication of the e algorithm, which allows a simple and efficient evaluation of the Shanks 
transformation, stimulated an enormous amount of research. According to Wimp (see p. 120 of 
ref . [23] ) over 50 articles on the e algorithm were published by Wynn alone, and at least 30 articles 
by Brczinski. As a fairly complete source of references Wimp recommends Brezinski's first book 
[19]. Since the main concern of this report are other sequence transformations and not Wynn's 
e algorithm, only those properties of the e algorithm will be discussed which are relevant for an 
understanding of its power as well as its limitations as a convergence acceleration and summation 
method. 

In a later article, Wynn [37] analyzed the convergence properties of the e algorithm by applying 
it to several model sequences. For instance, in the case of sequences, which have strictly alternating 
remainders r„ of the following type, 

oo 

s„ ~ s + (-1)"^ c^-/(n + /3)^+S /?eIR+, n^oo, (4.2-4) 

j=0 

Wynn [37] obtained assuming cq 7^ for fixed k an estimate which shows that the e algorithm 
accelerates convergence: 

4fc ~ « + 22fc(n + /3)2fc+i ' " ^ °° • (4-2-5) 

Wynn [37] also considered sequences which generalize the model sequence (4.1-5), 

00 

Sn ^ s + '^ CjXj^ , l>Ao>Ai>--->0, n^oo. (4.2-6) 

j=0 

For fixed k Wynn [37] obtained the following estimate which shows that the e algorithm 
accelerates convergence: 

(n) , {(Afc - Ao)(Afc - Ai) . . . (Afc - Afc_i)}2 rAO'7\ 
^'^"^ {(l-Ao)(l-A,)...(l-A,_,)P ^'-'-'^ 

Wynn [37] also applied the e algorithm to logarithmically convergent sequences of the following 
type: 

00 

sn ~ s + ^ cj- / (n + /3)^+i , /? G 1R+ , n ^ 00 . (4.2-8) 
3=0 

Assuming cq ^ 0, Wynn [37] obtained for fixed k an estimate which shows that the e algorithm - 
or cquivalcntly the Shanks transformation - is not able to accelerate the convergence of sequences 
of that type: 

4? ~ s + , , , n ^ 00 . (4.2-9) 
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This inability of accelerating logarithmic convergence is one of the major defects of the otherwise 
very powerful e algorithm. 

If the elements s„ of the sequence to be transformed are partial sums of a power series as in 
eq. (4.1-10), the e algorithm produces Pade approximants according to eqs. (4.1-11) and (4.2-2), 

4? = + ^/^l/C-^)' k,neJNo, (4.2-10) 

and the convergence theory of Pade approximants can be applied in this case. This convergence 
theory can be found in the standard references on Pade approximants, as for instance the books 
by Baker [18] or by Baker and Graves- Morris [22]. 



4.3. Programming the epsilon algorithm 

In this section it will be discussed how the e algorithm can be programmed efficiently. But first, 
the objectives of such a program, which performs the transformation of a given sequence {[sn]} 
with the help of Wynn's e algorithm, should be stated. 

Since it is in general not possible to predict by a priori considerations how many sequence 
elements will be needed until convergence has finally been achieved, such a program should be 
input-directed. This means it should read in the sequence elements sq, si, . . . , Sm, ■ ■ ■ successively 
starting with sq. After the input of each new sequence element Sm as many new elements e^"^ 

should be computed as is permitted by the recurrence formula (4.2-lb). That new element e^^\ 
which has the largest even subscript k, should be used as the new approximation to the limit of 

the sequence. 

Let us arrange the elements e^"'* of the e table in a rectangular scheme in such a way that the 
superscript n indicates the row and the subscript k the column of the 2-dimensional array: 



g{0) 
^0 

^0 

^0 

^0 



An) in) 



^(0) 

^2 

^2 

J3) 



An) 
^2 



tn 
.(3) 



An) 
tn 



(4.3-1) 



(n) 

The entries in the first column of the array are the starting values (-q = Sn of the recursion 
according to eq. (4.2-la). The remaining elements of the e table can be computed with the help 
of the recurrence formula (4.2-lb). This nonlinear 4-tcrm recursion connects four elements of the 
e table which are located at the vertices of a rhombus: 



An) 
-k 

(n+1) in+l) 



An) 



(4.3-2) 



If the sequence elements sq, si, . . . , Sm are used as initial conditions according to eq. (4.2-la), 
the recurrence formula (4.2-lb) is able to compute all elements e^j^ with < < m and 
< i < Obviously, these elements form an equilateral triangle located in the upper left 
corner of the e table. If the next sequence element Sm+i is also used as a starting value for the 
recursion (4.2-lb), the triangle will be enlarged by the neighbouring counterdiagonal g^.'""-'"'"^^ 
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with < j < m + 1. In this context it will be advantageous to rewrite Wynn's e algorithm, eq. 
(4.2-1), in the following way: 

e^^'^ =Sn, n > , (4.3-3a) 
eS'^~') = l/[s„-s„_i], n>l, (4.3-3b) 
-^■) = ef_-^+'^ + l/[e^;_7^'^ - ef_7^] , n > 2 , 2<j<n. (4.3-3c) 

Concerning the approximations to the limit it follows from eqs. (4.2-2) and (4.2-3) that one has 
to distinguish between even and odd values of the index m of the last sequence element Sm which 
was used in the recursion. If m is even, m = 2/x, our approximation to the limit of the sequence 
is the transformation 

{so,si, . . . ,S2;^} ef^ = e^(so), (4.3-4) 
and if m is odd, m = 2/x -|- 1, we use the transformation 

{si, S2, . . . , S2^^+l} e'^^ = e^(si). (4.3-5) 

With the help of the notation |a;| for the integral part of x, i.e., the largest integer v satisfying 
v < X, these two relationships can be combined into a single equation yielding 

r 1 (m-2[m/2]l) / \ //i o c\ 

lSm-2[m/2l,Sm-2|[m/2l+l, • • • ,Smj- ^ ^2[m/2]] " e^m/2i[Sm-2lrn/2j) ■ (,4.3-bj 

If the sequence elements s„ are partial sums of a power series as in eq. (4.1-10), our approxi- 
mations to the limit correspond according to eq. (4.2-10) to the following staircase sequence in 
the Pade table: 

[0/0] , [1/0] , [1/1] , . . . , [u/u] , [u + , + + . (4.3-7) 

Because of the rhombus structure (4.3-2) of the 4-term recursion in Wynn's e algorithm it 
appears that a program would either need a single 2-dimensional or at least two 1-dimensional 
arrays. However, Wynn [38] could show that a single 1-dimensional array is sufficient. Wynn's 
algorithm, which is called moving lozenge technique, is based upon the observation that for the 
computation of a new element only the two neighbouring elements and e^J^2''^^^ 

have to be known but not the whole upper counterdiagonal e^^~^^ with < /x < m. Hence, in 
Wynn's moving lozenge technique these quantities are stored in auxiliary variables while the 
recursion (4.3-3) moves along the current counterdiagonal ej™ •'^^^ with < j < m -|- 1 and 

overwrites the previous entries e^™ with < < m. A good description of Wynn's moving 
lozenge technique [38] can also be found in Brezinski's second book (see pp. 326 - 327 of ref. [20]). 

Wynn [38] performed the recursion in a 1-dimensional array E in which he stored the elements 
of the current counterdiagonal of the e table in such a way that the index of the array element 
coincides with the subscript of the corresponding element of the e table, 

^(m-j) _^ ^1^.^ ^ m>0, 0<i<m. (4.3-8) 

If the above convention is used three auxiliary variables will be needed. But Wynn's moving 
lozenge technique can be improved if the elements of the current counterdiagonal of the e table 
are stored in a 1-dimensional array E in such a way that the superscript of the corresponding 
element of the e table coincides with the index of the array element, 

_^ m > , < j < m . (4.3-9) 
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If this convention is used only two auxiliary variables will be needed and the structure of the 
resulting computer program will also be simpler and more elegant. The recursive scheme (4.3-3) 
can then be reformulated in terms of the elements of the array E in the following way: 

E{n) ^Sn, n>0, (4.3-lOa) 

E{n-1) ^l/[E{n) - E'{n-1)], n>l, (4.3-lOb) 
E{n - j) ^ E'{n - j + 1) + l/[E{n - j + 1) - E'{n - j)] , 

n>2, 2<j<n. (4.3-lOc) 

The primed array elements E'{n — j) and E'{n — j + 1) have to be stored in auxiliary variables 
since they will be overwritten during the computation of the current counterdiagonal e^"" with 
< j < n. The primes also indicate that the indices of the array elements E'(n — j) and 
E'{n — j + 1) refer to the occupation of E after the previous run, i.e., after the computation of 

the counterdiagonal ej^~-'~^^ with < j < n — 1. 

If a counterdiagonal e^"*~'^^ with < /x < m is computed with the help of the recursive scheme 
(4.3-3) and if the elements converge - which means that the whole process is successful - 

(n) 

the computation of the elements £2^+1 ^^^^ necessarily involve divisions by the small quantities 

^2k^^^ ~^2k ■ This may easily lead to an intolerable magnification of the inevitable rounding errors. 
Hence, it looks as if Wynn's e algorithm should be extremely susceptible to rounding errors. 

(n) 

Fortunately, this is normally not the case although the elements Cgj^^^^ may become quite large 
in magnitude and may have a very low relative accuracy due to the numerical problems described 

(n) 

above. But in the next step of the recursion the elements £2^+1 ^ divisors which will 

dampen the rounding errors again. Consequently, it is not clear what the overall effect will 
be. However, numerical experience indicates that in most cases of practical interest Wynn's e 
algorithm is remarkably stable. This experimental evidence is supported by a theoretical analysis 
of the numerical stability of the e algorithm which was performed by Wynn [37] in the case of 
several model sequences . 

In some cases - for instance if the elements of the sequence to be transformed are the partial 
sums of the Taylor series of a rational function - it may happen that the difference e.^'^^^ — 
vanishes. If pathologies of that kind occur, the so-called singular rules of the e algorithm can 
be used which were also derived by Wynn [39]. A good discTission of these singular rules and of 
related problems can also be found in section 4.1.2 of Brezinski's second book [20]. There, one 
can also find listings of FORTRAN IV programs for Wynn's e algorithm which partly use the 
singular rules mentioned above (see pp. 338 - 352 of ref. [20]). 

According to the limited experience of the author pathologies of that kind occur only rarely 
in scientific applications. Consequently, Wynn's singular rules are not used in the following 
FORTRAN 77 program EPSAL which computes the Shanks transformation of a given sequence 
by means of Wynn's e algorithm. However, a good program should take some precautions against 
an approximate equality of the elements e^"^^^ and e^"'* since in this case the reciprocal of the 
difference of these two elements could exceed the largest floating point number representable on 
the computer. This would lead to overflow and to an error termination of the program. 

This safeguard against overflow can be accomplished by defining two variables HUGE and 
TINY. Their values should be close to but not identical with the largest and smallest floating point 
numbers representable on the computer. If the difference e^,"^^^ — e^"^ is smaller in magnitude than 
TINY, then e^^^^ will be set equal to HUGE. If this approximate equality of the elements e^"^^' 

(n) 

and e^, was accidental the program can continue with the computation of the other elements 
of the e table producing numbers which are normally not noticeably affected. It is also possible 
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that this approximate equality of the elements and e^^ was not accidental but due to 

convergence. However, in this case the program should have been stopped before. 

In order to monitor the exact or approximate vanishing of the denominators, it may also be a 
good idea to define in a FORTRAN program for Wynn's e algorithm an error variable, for instance 
IFAIL, whose value is changed if one of the differences e[."^^^ — e^."'' is smaller in magnitude than 
TINY. 

The following FORTRAN 77 program EPSAL uses the modification (4.3-10) of Wynn's moving 

lozenge technique. It is safeguarded against approximate equality of the elements e^""''^'* and e^"^ 
by using two variables HUGE and TINY as described above. The elements s„ with ra = 0, 1, 2, . . . 
of the sequence to be transformed have to be computed in a DO loop in the calling program. 
Whenever a new sequence clement s„ is computed in the outer DO loop this subroutine EPSAL 
has to be called again and a new counterdiagonal of the e table will be calculated. The new 
sequence element s„ is read in via the variable SOFN and the approximation to the limit is 
returned via the variable ESTLIM. 

Finally, it is important to note that this subroutine EPSAL only calculates the approximations 
to the limit according to eqs. (4.3-3) and (4.3-4) and does not analyze the convergence of the 
whole process. This has to be done in the calling program. 

SUBROUTINE EPSAL (SOFN , N , E , LARRAY , ESTLIM) 
DIMENSION E(0: LARRAY) 

PARAMETER (HUGE = l.E+60, TINY = l.E-60, ZERO = O.EO, ONE = l.EO) 
E(N) = SOFN 
IF (N.EQ.O) THEN 
ESTLIM = SOFN 
ELSE 

AUX2 = ZERO 
DO 10 J = N,l,-1 
AUXl = AUX2 
AUX2 = E(J-l) 
DIFF = E(J) - AUX2 
IF (ABS(DIFF) .LE. TINY) THEN 

E(J-l) = HUGE 
ELSE 

E(J-l) = AUXl + ONE/DIFF 
END IF 
10 CONTINUE 

IF ( M0D(N,2) .EQ. ) THEN 

ESTLIM = E(0) 
ELSE 

ESTLIM = E(l) 
END IF 
END IF 
RETURN 
END 
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5. The iteration of Aitken's A process 

5.1. Aitken's transformation and its iteration 

Let us consider the following model sequence which is obtained by setting k = 1 in eq. (4.1-5): 

Sn = s + cy , CT^O, |A| < 1, nGlNo- (5.1-1) 

Each sequence element Sn contains the three unknowns c, A, and the limit s. Consequently, 
a sequence transformation will at least require three elements of the above model sequence for 
the determination of the limit s. In order to derive such a transformation we form the first and 
second differences of s„: 

Asn =cA"(A-l), (5.1-2) 
A'^sn = cA"(A - 1)^ . (5.1-3) 

A short computation shows that the following sequence transformation is exact for the model 
sequence (5.1-1): 

4") = - , neJNo. (5.1-4) 

This sequence transformation is Aitken's well-known A^ process [12]. The structure of this 
transformation explains quite clearly why it bears this name. 

(n) 

It follows at once from the derivation of the sequence transformation A\ via the model sequence 
(5.1-1) that it is a special case of the Shanks transformation, eq. (4.1-4), or Wynn's e algorithm, 
eq. (4.2-1), 

4"^ = e,{sn) = et^ . (5.1-5) 

Many other representations for Aitken's A^ process can be derived by suitable manipulations 
of eq. (5.1-4). Examples are: 

4^) = sn^, - l^f4^ (5.1-6) 

- Sn+2 7^- yp-^-') 



n 

2 



A2s, 

Sn+2Sn — [Sn+l] 
A'^Sn 

[ASn+l]Sn+l - [ASn]Sn+2 

A-^Sn 
[Asn+l]Sn - [As 



A2 



(5.1-8) 
(5.1-9) 
(5.1-10) 



n 



Sn+1 + .r. 1 , (5.1-11) 

A[l/As„J 



A[Sn+l/ASn] 

A [1/As„] 



(5.1-12) 



Aitken's A^ process was studied in articles by Shanks [15], Clark, Gray, and Adams [35], Lubkin 
[40], Tucker [41,42], Cordellier [43], and Bell and Phillips [44]. A multidimensional generalization 
of Aitken's transformation to vector sequences was discussed by MacLeod [45]. Modifications of 
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Aitken's process were proposed by Drummond [46] and by Bj0rstad, Dahlquist, and Grosse 
[47]. 

The properties of Aitken's process are discussed in books by Brezinski (see pp. 37 - 40 of 
ref. [19] and pp. 43 - 45 of ref. [20]) and Wimp (see pp. 149 - 152 of ref. [23]). Those properties 
which are particularly important for our purposes can be summarized as follows: 

(i) : The A^ process accelerates Hnear convergence. 

(ii) : The A^ process is regular but not accelerative for logarithmically convergent sequences of 

the type of eq. (4.2-8). 

This shows that Aitken's A^ process has similar properties as Wynn's e algorithm. In view of 
eq. (5.1-5) this is not surprising. However, one cannot expect that Aitken's A^ process will be 

(n) 

as powerful as Wynn's e algorithm. The reason is that the transform A\ is produced by only 

(n) 

three sequence elements Sn,Sn-\-i, and Sn+2 which implies that Ai is a transformation of order 
£ = 2. This will certainly limit the power as well as practical usefulness of this transformation. 

If the accelerative power of Aitken's transformation turns out to be insufficient and if it is 
necessary to use a more powerful sequence transformation one could of course use Wynn's e 
algorithm which because of eq. (5.1-5) can be considered to be a more complex and also more 
powerful generalization of Aitken's A^ process. Another alternative, which also produces sequence 
transformations with higher transformation orders, would be to iterate the A^ process. This 
means that Aitken's A^ process will be applied to the transformed sequence {[>A^"^]} yielding a 

new sequence {[^2"^]}- This process can in principle be repeated indefinitely. 

In order to obtain some heuristic motivation for this iteration, let us apply Aitken's A^ process 
to the following model sequence which generalizes the sequence (5.1-1): 

Sn = s + ax"^ + by'' , < < ]x| < 1 , a,b^O. (5.1-13) 

A short calculation shows that Aitken's A^ process eliminates the dominating term ax" from 
the model sequence (5.1-13): 

= , + 6[(x-y)/(x-l)]V 

^ l + {b/a)[iy-l)/ix-l)ny/xr ' ^ ' ^ 

Since we have by assumption 0<|y|<|x|<l, the transformed sequence (5.1-14) converges 
faster than the original sequence (5.1-13). Also, since (y/x)" vanishes as n ^ oo, at least for large 
values of n the elements of the resulting sequence (5.1-14) have essentially the same structure as 
the elements of the sequence (5.1-1). 

For the iteration of Aitken's A^ process each of the numerous representations for given 
above can be used since they are all mathematically equivalent. However, the various represen- 
tations for A^i^"^ differ considerably in their numerical stability. In the book by Press, Flannery, 
Teukolsky, and Vetterling (see p. 133 of ref. [48]) it is remarked that Aitken's A^ process should 
be computed with the help of eq. (5.1-4) since the other equivalent representations are numerically 
less reliable. Numerical studies performed by the author confirmed this statement. Consequently, 
in this report an iteration of Aitken's A^ process will always be based upon eq. (5.1-4). If we iden- 
tify the sequence elements s„ with the initial values ^o"^'* of the recursion we obtain the following 
nonlinear recursive scheme: 



=sn , (5.1-15a) 

,(n) _ ^(n) _ 

AM' 



^^+1 = - ' k,ne^o. (5.1-15b) 



k 



29 



As usual, the difference operator A acts upon the superscript n and not upon the subscript 
k. It follows from this recurrence formula that the computation of requires the sequence 
elements s„, Sn+i, ■ • • , Sn+2fc- Consequently, is a transformation of order 2k. In this respect 

.4^"^^ is equivalent to which needs the same set s„, s^+i, . . . , Sn+2k of sequence elements for 
its computation. However, we shall see later that the numerical properties of Wynn's e algorithm 
and Aitken's iterated process often differ considerably although they are both generalizations 
of the same sequence transformation Ai^\ eq. (5.1-4). 

The numerical properties of Aitken's iterated A^ process were studied by Smith and Ford [30]. 
Concerning the theoretical properties of Aitken's iterated A^ process, very little seems to be 
known. Apparently, there is only one article by Hillion [49] in which the theoretical properties of 
Aitken's iterated A^ process were studied. Hillion was able to find a model sequence for which the 
iterated A'^ process is exact. He also derived a determinantal representation for the transforms 
A^l^^ . However, Hillion's expressions contain in both eases explicitly the lower order transforms 
. . . , 4"_\, . . . , 4"+"), . . . , 41+"). Consequently it seems that not much insight about the 
properties of Aitken's iterated A'^ process can be gained by these results. 



5.2. Programming Aitken's iterated A^ process 



A program for Aitken's iterated A^ process should have the same features as the subroutine 
EPSAL which transforms a given sequence {[sn]} with the help of Wynn's e algorithm. This means 
it should read in the sequence elements sq, si, . . . , Sm, ■ ■ ■ successively starting with sq. After the 
input of each new sequence element as many new elements A^J^^ of the Aitken table should be 



computed as it is permitted by the recursive scheme (5.1-15). That element 4"^' which has the 
largest subscript k, should be used as the new approximation to the limit of the sequence {[sn]}- 
Let us arrange the elements A^^^ of the Aitken table in rectangular scheme in such a way that 
the superscript n indicates the row and the subscript k the column of the 2-dimensional array: 
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(1) 
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(5.2-1) 



The entries in the first column of the array are the starting values 4™'' = of the recursion 
according to eq. (5.1-15a). The remaining elements of the Aitken table can be computed with the 
help of the recurrence formula (5.1-15b). The 4 elements, which are connected by this nonlinear 
recursion, form a pattern in the Aitken table which looks like the move of a knight on the 
chessboard: 



4"' 



A 



(n+2) 



(5.2-2) 



This pattern implies that the recursion (5.1-15b) has to proceed along a relatively complicated 
path in the Aitken table if the elements sq, si, . . . , s^, . . . are read in successively and if one tries 
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to increase the subscript k as much as possible. In this context, it is advantageous to rewrite the 
recursive scheme (5.1-15) in the following way: 

A^^^ =Sn, n > , (5.2-3a) 

^n-2,)^^n-2,)_ ^ ^^^^J^ , n>2, 1 < j < ^2} . (5.2-3b) 

Here, [[n/2]] denotes the integral part of n/2, i.e., the largest integer satisfying < n/2. If 
the sequence elements sq, si, . . . ,Sm are used as starting values, the recursion (5.2-3b) is able to 
compute all elements Aj^ with < /j, < m and < j < [[/x/2]]. If the next sequence element 
Sm+i is also used as a starting value for the recursion, this set of elements of the Aitken table will 
be enlarged by the string with < j < |(m + l)/2]. 

As in Wynn's e algorithm the approximation to the limit depends upon the index m of the last 
sequence element which was used in the recursion. If m is even, m = 2fj,, our approximations 
to the limit of the sequence are the transformations 

{so,si,...,S2^} ^ 4°), (5.2-4) 

and if m is odd, m = 2/x -|- 1, the approximation to the limit will be 

{si,S2,...,S2^+i} -> A'^^K (5.2-5) 

As in the case of Wynn's e algorithm, these two relationships can be combined into a single 
equation, 

r \ 2|[m/2]]) /_ r, /?\ 

\'5m-2|[m/2li '5m-2[[m/2j+li • • • ) "5m / — > ^[m,/2l ' [O.Z-0) 

Because of the relatively complicated geometrical structure (5.2-2) of the recursion (5.2-3b) it 
appears that a program, which computes Aitken's iterated process, would need a 2-dimensional 
array. However, a single 1-dimensional array A is sufficient if the elements of the Aitken table are 
stored according to the following rule: 

A'f^J^^ ^ A{n-u), n>0, 0<i^<n. (5.2-7) 

With this convention the recurrence formula (5.2-3) can be reformulated in terms of the elements 
of the 1-dimensional array A: 

A{n) ^Sn, n > , (5.2-8a) 

A{n-2j)^A{n-2j) n>2, l<j<ln/2j. (5.2-8b) 

Aitken's iterated transformation makes sense only if the second differences A'^A^^}-^ do not 
vanish for sufficiently large values of k. This will certainly be guaranteed if for fixed k all elements 
of the sequence {[^^l^]} are different from zero and strictly alternating in sign. 

Unfortunately, the above statement is not particularly helpful since only very little is known 
about the theoretical properties of Aitken's iterated A^ process. In addition, it does not help at 
all if the initial sequence {[sn]} is not alternating. A related problem, which may easily arise in this 
context, is that some second differences A'^A^^}^ may become so small that division would lead 
to overflow. Consequently, a good program should be protected against the exact or approximate 
vanishing of the second differences A'^A^^}i. 
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As in the case of Wynn's e algorithm this can be accomphshed by introducing two variables 
HUGE and TINY which have values that are close to but not identical with the largest and 
smallest floating point number representable on the computer. If A^^^,*^^ is smaller in magnitude 

than TINY, ^["^ will be set equal to HUGE and the recursion is continued. 

The following FORTRAN 77 subroutine AITKEN performs the recursive computation of the 
Aitken table in a single 1-dimensional array A according to eq. (5.2-7). It is safeguarded against 

an exact or approximate vanishing of the second differences A^A^^}-^ by using two variables HUGE 
and TINY. The elements s„ with n = 0, 1,2, . . . of the sequence to be transformed have to be 
computed in a DO loop in the calling program. Whenever a new sequence clement ,s„ is computed 
in the outer DO loop this subroutine AITKEN has to be called again and a new string Aj^ "^^^ 
with < j < \n/2\ will be calculated. The new sequence element s„ is read in via the variable 
SOFN and the approximation to the limit is returned via the variable ESTLIM. 

It is important to note that this subroutine AITKEN only calculates the approximations to 
the limit according to eqs. (5.2-4) and (5.2-5). The convergence of the whole process has to be 
analyzed in the calling program. 

SUBROUTINE AITKEN (SOFN , N , A , LARRAY , ESTLIM) 
DIMENSION A(0: LARRAY) 

PARAMETER ( HUGE = l.E+60 , TINY = l.E-60 , TWO = 2.E0 ) 

A(N) = SOFN 

IF (N.LT.2) THEN 

ESTLIM = SOFN 
ELSE 

LOWMAX = N/2 

DO 10 J = 1, LOWMAX 
M = N - 2*J 

DENOM = A(M+2) - TW0*A(M+1) + A(M) 
IF (ABS (DENOM) .LT. TINY) THEN 

A(M) = HUGE 
ELSE 

A(M) = A(M) - (A(M) - A(M+1))**2 / DENOM 
END IF 
10 CONTINUE 

IF ( M0D(N,2) .EQ. ) THEN 

ESTLIM = A(0) 
ELSE 

ESTLIM = A(l) 
END IF 
END IF 
RETURN 
END 
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6. Wynn's rho algorithm and related topics 

6.1. Polynomial and rational extrapolation 

Assume that the values of a function f{x) are only known at some discrete points xq < xi < 
■ ■ ■ < Xm- It is one of the classical problems of numerical analysis to estimate the value of / 
at some point ^ ^ {xo,a^i, • • • ,Xm}- If a;o < < Xm, this problem is called interpolation, and if 
either ^ < xq oi Xm < this problem is called extrapolation. These problems and their solution 
are discussed in any book on numerical analysis. More specialized treatments of these topics can 
be found in a monograph on interpolation by Davis [50] or in a review article on extrapolation 
processes by Joyce [51]. 

Extrapolation techniques can be used for the construction of convergence acceleration methods. 
In this approach, the existence of a function 5 of a continuous variable is postulated which 
coincides on a discrete set of arguments {[a;„]| with the elements of the sequence {[s„]| to be 
transformed, 

S{Xn) = Sn, nGlNo. (6.1-1) 

This ansatz reduces the problem of accelerating the convergence of a sequence {[sn]} to an 
extrapolation problem. If a finite string s„i, Sm+i, • • • , Sm+fc of /c + 1 sequence elements is known 
one can construct an approximation Sk{x) to S{x) which satisfies the k+1 interpolation conditions 

Sk{xm+j) = Sm+j , < j < A; . (6.1-2) 

In the next step one has to determine the value of the approximant 5fe(x) for x x^o- If this 
can be done and if the assumptions which are implicitly contained in this ansatz - the existence 
of a function S{x) which can be approximated at least locally by a suitable set of interpolating 
functions - are justified, one can expect that the extrapolated value Sk{xoo) will provide a better 
approximation to the limit s of the sequence than the last sequence element s„i+k which 

was used for the construction of Sk{x). 

In interpolation and extrapolation problems the function under consideration has to be modelled 
either in between or beyond a finite set xo,xi, . . . ,Xn of interpolation points by a suitable set 
of interpolating functions. These interpolating functions should be flexible and general enough 
to produce good approximations for large classes of functions which can occur in practice. In 
addition, they should also be simple enough to be manageable. The most common interpolating 
functions are either polynomials or rational functions. These two sets will also lead to different 
convergence acceleration methods. 

If interpolation by polynomials is used as the basis of a convergence acceleration method it is 
implicitly assumed that the k-th order approximant Sk{x) is a polynomial of degree k in x, 

Skix) = Co + cix + • ■ ■ + Ckx'' . (6.1-3) 

For polynomials, the most natural extrapolation point is x = 0. Consequently, the interpolation 
points Xn have to satisfy the conditions 

Xq > Xi > X2 > ■ ■ ■ > Xm > Xm+1 > • ■ ■ > , (6.1-4a) 
lim Xn = 0. (6.1-4b) 

n— »oo 

The choice a; = as the extrapolation point implies that the approximation to the limit is to 
be identified with the constant term cq of the polynomial (6.1-3). 

Several different methods for the computation of interpolating polynomials Sk{x) are described 
in the mathematical literature. Since only the constant term of a polynomial Sk has to be 
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computed and since in most applications it is desirable to compute simultaneously a whole string 
of approximants (So(0),>Si(0),(S2(0), . . ., the most economical choice is Neville's scheme [52] for the 
recursive computation of interpolating polynomials. In the case a; = Neville's algorithm reduces 
to the following 2-dimensional linear recursive scheme (see p. 6 of ref. [20]): 

MQ"'\sn,Xn) = Sn, n G INq , (6.1-5a) 
./-(«)/ \ Xn-N"^ \sn+l-,Xn-\-\) — Xn+k+l-^k \^n,Xn) , , 

A/^4.\(sn,a;n) = z Z ' k,n gJNq. (6.1-5b) 



Xfi -''n+fc+l 

In the literature on convergence acceleration this variant of Neville's recursive scheme is usually 

called Richardson extrapolation [53]. Obviously, the linear transformation A/'^"''(s„, is exact 
if the sequence elements Sn are polynomials of degree k in the interpolation points Xn, i.e., for 
model sequences of the following type: 

fc-i 

Sn = s + Cjxi+^ , fc, n G INo . (6.1-6) 
j=o 

The most obvious interpolation points for the Richardson extrapolation scheme, eq. (6.1-5), are 
Xn = ^/{n + P) with /? > or also Xn = l/{n + (3)'^ . These two choices are known to work quite 
well in a variety of cases. However, if either one of these sets of interpolation points {[xn]} is used, 
the Richardson extrapolation scheme (6.1-5) is not regular, i.e., the convergence of a sequence 
{[s„]} to some limit s does not imply the convergence of the transformed sequence to the same 
limit. In Brezinski's second book (sec pp. 37 - 38 of ref. [20]) it is shown that the regularity 
of the Richardson extrapolation scheme is guaranteed only if some a > 1 exists such that the 
interpolation points {[x„]} satisfy for all n G INq: 

Xn/Xn+l > a . (6.1-7) 

This condition (6.1-7) is obviously fulfilled if the interpolation points \xn^ satisfy Xn = with 
< 6 < 1 for all n € INq. A good discussion of the properties of the Richardson extrapolation 
scheme as well as a list of various different sets of interpolation points {[x^]} can be found in 
Brezinski's second book (see pp. 36 - 42 of ref. [20]). 

It is well known that some functions can be approximated by polynomials only quite poorly 
but by rational functions they can be approximated very well. Consequently, it is likely that 
at least for some sequences {[s„]} rational extrapolation will give better results than polynomial 
extrapolation. Let us therefore assume that the approximant S}~ {x) can be written as the ratio of 
two polynomials of degrees £ and m, respectively, 

Sk{x) = —— — ^ -T — k,i,melNo. (6.1-8) 

60 + hx + b2X^ -I h bmX"^ 



This rational function contains i + m + 2 coefficients ao, . . . ,a£ and bo, . . . ,bm- However, only 

i+m + 1 coefficients are independent since they are determined only up to a common nonvanishing 
factor. Usually, one requires either 60 = 1 or 6^ = 1- Consequently, the k + 1 interpolation 
conditions (6.1-2) will determine the coefficients ao, . . • , and bo,. . . ,bm provided that k = i + m 
holds. 

The extrapolation point x = is also the most obvious choice in the case of rational extrapola- 
tion. Extrapolation to x = implies that the interpolation points {[xn]| have to satisfy eq. (6.1-4) 
and that the approximation to the limit is to be identified with the ratio ao/60 of the constant 
terms of the polynomials in eq. (6.1-8). 
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However, if in eq. (6.1-8) i = m holds, extrapolation to infinity is also possible. In that case 
the interpolation points would have to satisfy 

< xo < xi < X2 < • • • < Xjji < Xjji+i < ■ ■ , (6.1-9a) 
lim Xn = oo . (6.1-9b) 

n^oo 

In the case of extrapolation to infinity only the coeflacients a£ and bg of the polynomials in eq. 
(6.1-8), which are proportional to highest power x^, contribute. Consequently, the approximation 
to the limit has to be identified with the ratio ai/bg. 

As in the case of polynomial interpolation several different algorithms for the computation of 
rational interpolants are described in the literature. A discussion of the relative merits of these 
algorithms as well as a survey of the relevant literature can be found in chapter III of a book by 
Cuyt and Wuytack [54] which was recently published . 



6.2. Wynn's rho algorithm 

Wynn's p algorithm [25] is designed to compute even-order convergents of Thiclc's interpolating 
continued fraction [55] and to extrapolate them to infinity. The even-order convergents are rational 
functions of the following type: 

Ukx'' + Qk-ix''-'^ + --- + aix + ao /« o i \ 

bkx'^ + bk-ix'^ ^ H \-bix + bo 

This means that the ratio a^/bk is to be identified with the approximation to the limit. 
According to Cuyt and Wuytack (see p. 214 of rcf. [54]) Wynn's p algorithm performs the 
computation of the interpolating rational function (6.2-1) and its extrapolation to infinity with a 
smaller number of arithmetic operations than similar recursive algorithms. 

Wynn's p algorithm [25] is the following nonlinear recursive scheme which is formally almost 
identical with Wynn's e algorithm, eq. (4.2-1): 

p9 =0, pf,"^ = sn, (6.2-2a) 

Pk+1 - Pk-1 + (n+1) _ in) ' n e INo . (6.2-2b) 

Pk Pk 

The only difference between Wynn's e and Wynn's p algorithm is that the p algorithm also 
involves a sequence of interpolation points {[x„]} which have to satisfy eq. (6.1-9). As in the case 

(n) 

of Wynn's e algorithm only the elements p2iJ with even orders serve as approximations to the 

(n) 

limit. The elements P2fc+i ^^^^ orders are only auxiliary quantities which diverge if the whole 
process converges. 

Despite their formal similarity, the e and p algorithm differ significantly in their ability of 
accelerating convergence. For instance, the e algorithm is exact for the model sequence (4.1-5), 
and is known to be a very efficient accelerator for linearly convergent sequences. In many cases the 
e algorithm is also able to sum divergent series. However, the otherwise very powerful e algorithm 
fails to accelerate logarithmic convergence. 

The properties of Wynn's e algorithm and Wynn's p algorithm are in some sense complementary. 
Wynn's p algorithm fails to accelerate linear convergence and is not able to sum divergent series. 
However, it is very powerful for some logarithmically convergent sequences. This can easily be 
understood on the basis of the following model sequence for which the transform p^ is exact: 

sx'^ + aix^-'^ -\ h ajfc u r-T\i ^« o Q^ 

Sn = — ; — i—i — , k,ne^o- (6.2-3) 

x^ + bix'^ ^ + --- + bk 
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Since for fixed k G JNq the zeros of the numerator and denominator polynomials in eq. (6.2-3) 
are contained in a compact set and since the interpolation points diverge as n ^ oo, at least 
for sufficiently large values of n a rational function of that kind will change only relatively slowly 
and monotonously with increasing n. Certainly, such an expression will not oscillate or even 
diverge. This should explain why the p algorithm normally works well in the case of logarithmic 
convergence but fails in the case of oscillating or divergent sequences. 

The properties of Wynn's p algorithm are discussed in books by Brczinski (see pp. 102 - 106 
of ref. [19] and pp. 96 - 102 of ref. [20]) and Wimp (see pp. 168 - 169 of ref. [23]). In these 
books the connection of the p algorithm with interpolating continued fractions is emphasized and 

(n) 

it is also shown that the transforms can be represented as the ratio of two determinants. But 
otherwise, relatively little seems to be known about this sequence transformation. 

The most obvious interpolation points {[x„]} are Xn = n + P with (3 > 0. With this choice, 
Wynn's p algorithm assumes its standard form: 

=0, pi") = Sn, (6.2-4a) 

pSi = Pti^ + J,^' k,nelNo. (6.2-4b) 

Pk -Pk 

Other possible sequences of interpolation points as for instance Xn = {n + f3)'^ with /? > are 
discussed in Brezinski's second book [20]. 

As in Wynn's e algorithm the approximation to the limit depends upon the index m of the last 
sequence element s„i which was used in the recursion. If m is even, m = 2fi, our approximation 
to the limit of the sequence is the transformation 

{so,xo;si,xi;...;s2n,X2ij.} P2°\ (6.2-5) 
and if m is odd, m = 2fi + 1, we use the transformation 

{si,xi;s2,X2;...; S2//+1 , 2:2^+1 } ^ P21I ■ (6.2-6) 

With the help of the notation |[a;| for the integral part of x, i.e., the largest integer u satisfying 
v < X, these two relationships can be combined into a single equation yielding 

r \ (m-2|[m/2]]) „ rv\ 

\*m-2[TO/2l) ^m-2[[m/2]; ■Sm-2[[m/2|+l) 3;rra-2[m/2|+i; • • • ; ■Sni) a^m/ ^ P2[m/2]] ' VO-^-'j 

The elements of the p table can be arranged in the same rectangular scheme as the elements 
of the e table in (4.3-1). Since the recurrence relationships for Wynn's e algorithm and Wynn's 
p algorithm are structurally identical, those elements of the p table which are connected by the 
4-term recurrence formula (6.2-2b), are also located in the p table at the vertices of a rhombus: 

(n) (n) 

Pk-1 Pk 

Consequently, Wynn's p algorithm can be programmed in exactly the same way as Wynn's e 
algorithm. For that purpose we rewrite the recursive scheme (6.2-2) in the following way: 

Po") =Sn, n > , (6.2-9a) 
p\ = , n > 1 , (6.2-9b) 

^n—l 

f^-''=f^^''+ (n^r^l.-.) ' "^2, 2<j<n. (6.2-9C) 
Pj-i Pj-i 
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As in the case of the e algorithm the modification (4.3-9) of Wynn's moving lozenge technique 
(4.3-8) can be used. This means that only a single 1-dimensional array R will be needed if the 

elements of the current countcrdiagonal p^J^ ''^ with m, G INq and < j < m are stored in R 
in such a way that the superscript of the element of the p table coincides with the index of the 
corresponding array element, 

p{rn-j) _^ R{rn-3). (6.2-10) 

The only difference with Wynn's e algorithm is that also a second 1-dimensional array ^ will 
be needed in which the interpolation points stored according to the rule 

Xn ^ i{n). (6.2-11) 

With these two conventions the recursive scheme (6.2-9) can be reformulated in terms of the 
elements of the 1-dimensional arrays R and ^, 



R{n) ^Sn, n>0, (6.2-12a) 

n > 1, 
C{n) - i{n- j) 



n>l, (6.2-12b) 



R{n) - R'{n - 1) 
R{n - j) ^ R'{n - j + 1) + 



R{n + R'{n - j) ' 
n>2, 2<j<n. (6.2-12c) 

As in the case of Wynn's e algorithm, the primed array elements R'{n — j) and R'{n — j + 1) 
have to be stored in auxiliary variables. The primes also indicate that the array elements R'{n—j) 
and R'{n — j + refer to the occupation of R after the previous run, i.e., after the computation 
of the countcrdiagonal p^ ^ with < j < n — 1. The listings of some FORTRAN IV programs, 
which compute Wynn's p algorithm, can be found in Brezinski's second book (see pp. 361 - 365 
ofref. [20]). 



6.3. The iteration of Wynn's rho algorithm 

According to eq. (5.1-5), Aitken's process is identical with the transform 

4") = - = , n G INo . (6.3-1) 

If Aitken's process is iterated, a new sequence transformation vA^.*^^ results which has a 
similar ability of accelerating convergence as Wynn's e algorithm. However, in section 13 we shall 
encounter some examples in which Aitken's iterated A^ process clearly outperforms Wynn's e 
algorithm. This alone should justify an analysis of Aitken's iterated A^ transformation A^^\ 

Since Wynn's e algorithm (4.2-1) and Wynn's p algorithm (6.2-2) are formally almost identical, 
one can construct a new sequence transformation by proceeding as in the case of Aitken's iterated 
A^ process. This means that first the transform pg"^ is expressed in terms of some sequence 
elements s„ and interpolation points x„ The resulting expression for p^"^ will then be iterated. 

From eqs. (6.2-2a) and (6.2-2b) we obtain the following expression for the p analogue of Aitken's 
A^ process: 

in) _ (xn+2-a:„)[Ag„+i][Ag„] 

[AXn+l][As„] - [AXn][ASn+l] 
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An iteration of this expression, which may be considered to be a kind of weighted process, 
can be done in a variety of ways. The problem is that there is no unique way of choosing tlie indices 
of the interpolation points Xn- However, if we take into account that in Wynn's p algorithm, eq. 
(6.2-2), the differences of the indices of the interpolation points Xn increase with increasing k, 
we see that the following nonlinear recursive scheme should be the most natural iteration of the 
transform (6.3-2): 

W^^ =Sn, neJNo, (6.3-3a) 

k,ne'5No. (6.3-3b) 



W^^\ = Wi"+^) + (x„+2fe+2-x„)[Aw("+^)] [Awf^] 

h n a Tl\r„ 



As usual it is assumed that the difference operator A acts upon n and not upon k. The most 
obvious interpolation points are as in Wynn's p algorithm a;„ = n + /? with /3 > 0. With this 
choice, the iterated p2 transformation assumes its standard form: 

Wj"^ =sn, neJNo, (6.3-4a) 

(n) (n+i) (2A; + 2)rA>vf"+'^UAwf"^l 

^k+i = - L ' fc, n G INo . 6.3-4b 

^ (2)fc + l)A2>vf^ 

The table of this transformation can be arranged in the same rectangular scheme as the Aitken 
table (5.2-1). Also, the recurrence formulas for Aitken's iterated A^ process, eq. (5.1-14), and 

(n) 

the recurrence formulas for the transforms are structurally identical. This implies that the 

four elements, which are connected by the nonlinear recurrence formulas (4.3-2) or (4.3-3), also 
form a pattern in the W table which looks like the move of a knight on the chessboard: 

Wf+') (6.3-5) 

Consequently, this iterated p2 process can be programmed in exactly the same way as Aitken's 

iterated A^ process and only a few minor alterations have to be done in the subroutine AITKEN. 
In this context, it is advantageous to reformulate the recurrence scheme (6.3-4) in the following 
way: 

W^"^ =Sn, n>0, (6.3-6a) 

,,(n-2.) , (x. - X„.,,) [AWj-^^'^^)] [Awj^^^')] 

{Xn - Xn-2J+l) [AW^T,''^] - (Xn-l - Xn-2j) [Aw]:!^'''^'^] ' 

n>2 , 1 < j < [ra/2]l . (6.3-6b) 

As usual, [[n/2]] stands for the integral part of n/2, i.e., the largest integer u satisfying u < n/2. 
If the sequence elements sq, si, . . . , Sm are used as starting values, the recursive scheme (6.3-6) is 
able to compute all elements wj^ ^"'^ with < p, < m and < j < [m/^I- 

As in the case of Aitken's iterated A^ process the approximation to the limit depends upon the 
index m of the last sequence element Sm which was used in the recursion. If m is even, m = 2p, 
our approximations to the limit of the sequence are the transformations 

X2A ^ W(°) , (6.3-7) 
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and if m is odd, m = 2// + 1, the approximation to the hmit will be 

{si,xi;s2,X2;. . . ,S2fj.+i, X2^+i} ^ >V(i) . (6.3-8) 
These two relationships can be combined into a single equation, 

/ \ 1/\)('"-2[m/2|) /r. Q Q\ 

\*m-2|[m/2]])3:^-2|[m/2]]; *m-2|[m/2]]+l)3:^m-2|[m/2]]+i; • • • ; ^mi 2:m/ ' ;,D.C>-yj 

Only two 1-dimensional arrays w and ^ are needed if the interpolation points x„ are stored in 
^ according to eq. (6.2-11) and if the elements Wj^"^ are stored in w according to the following 
rule: 

^tin Hn-i^), n>0, 0<i/<n. (6.3-10) 

With this convention the recursive scheme (6.3-6) can be reformulated in terms of the elements 
of the 1-dimensional arrays w and ^: 

w{n) Sn , n>Q, (6.3-lla) 

^' ^ ^ [e(n) - + mAw{£)] - [^n - 1) - m][^Hi + 1)] ' 

i = n-2j , n>2 , l<j< |n/2| . (6.3-llb) 
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7. The Levin transformation 



7.1. The derivation of Levin's sequence transformation 

Levin's sequence transformation [28] is designed to be exact for model sequences of the following 
type: 

fc-i 

Sn = s + UnY^ Cj/{n + 13^ , A:, n G INq . (7.1-1) 
j=o 

Here, the remainder estimates a;„ are essentially arbitrary functions of n. It is only assumed 
that they are different from zero for all finite values of n. In addition, it would not make much 
sense to consider in convergence acceleration and summation processes remainder estimates which 
are constant. Consequently, we shall also assume that for all finite values of n the elements of the 
sequence {[i^n]} arc all distinct. Depending upon the behaviour of the remainder estimates {[a;.„]} 
as n — > oo, the sequence {[s„]} may either converge or diverge. In eq. (7.1-1) it has to be required 
that /3 + n must not be zero. This implies that the parameter /3 must not be zero or a negative 
integer. However, the elements of the model sequence (7.1-1) will serve as finite approximations 
to Poincare-type asymptotic expansions of the following kind: 

oo 

Sn ~ S + LOn'Y Cj/{n + Py , H ^ OO . (7-1-2) 

j=0 

In expansions of that kind negative values of /3 will lead to different signs of the terms if either 
n-|-/?<0orra-|-/3>0 holds. Since model sequences of the type of eq. (7.1-1) will be used 
as approximations for asymptotic expansions of the above type and since these approximations 
should be uniformly valid over a wide range of admissible values of n - preferably for all n > 
- it is necessary to require that the sign pattern of the terms of the sum in eq. (7.1-1) must not 
depend upon n. This rules out /? < and we have to require /? > 0. But otherwise, the parameter 
f3 is in principle completely arbitrary. In the literature on Levin's sequence transformation, only 
the case (3 = 1, which is the most obvious choice, has been considered so far. 

In eq. (7.1-1) there occur A; -|- 1 unknown quantities, the limit or antilimit s and the k linear 
coefficients cq, . . . , Ck-i- Hence, k + 1 sequence elements Sn, ■ ■ ■ , Sn+k needed for the determi- 
nation of s, and according to Cramer's rule the general Levin transformation C^\l3, Sn,(^n) can 
be defined by the following ratio of determinants: 





^n+k 




^n+k 




. Un+k/{P + n + kf-^ 


1 


1 




'■^n+k 







(7.1-3) 



If the sequence elements s„, s„+i, . . . , satisfy eq. (7.1-1) then Levin's general sequence 
transformation is exact by construction, i.e.. 



^i"H/5>Sn,Wn) = S. 



(7.1-4) 
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The representation of the general Levin transformation as the ratio of two determinants is 
not well suited for practical applications because the fast and reliable evaluation of large order 
determinants is a not yet satisfactorily solved problem of numerical analysis. Thus, alternative 
expressions for the general Levin transformation are highly desirable. Fortunately, they can be 
derived quite easily. 

Levin's original derivation [28] of nondeterminantal expressions for his sequence transformation 
was based upon the observation that the determinants in eq. (7.1-3) may be expressed in terms 
of Vandermonde determinants. However, for our purposes it is advantageous to follow Sidi's 
approach [56] which exploits properties of the difference operator A, since this approach can 
easily be extended to other sequence transformations which will be treated later in this report. 
For that purpose, eq. (7.1-1) is rewritten in the following way: 

k-l 

in + f3)''-'[sn - sj/iVn = Yl + /^)'"'"' • (7-1-5) 

j=0 

The highest power of n, which occurs on the right-hand side of eq. (7.1-5), is n^~^. We now 
utilize the well-known fact that any polynomial of degree A; — 1 in n will be annihilated by the 
difference operator A^. Since the difference operator A^ is linear, we may conclude from eqs. 
(7.1-4) and (7.1-5) that the general Levin transformation >C^"^(/3, s„,a;„) is given by the following 
ratio: 

An)(g ^ _ An(n + ^)^-^Wa;n} . 

With the help of eq. (2.4-8) the action of the difference operators in eq. (7.1-6) can be expressed 
in closed form. This leads to a representation of the general Levin transformation as the ratio of 
two finite sums: 



Em: 



k\ {fi + n + jf-^ Sn+j 



jJ iP + n + k)''-^ LOn+j 



Cf\f3,sn.un) = '-^ , A;,nG]No. (7.1-7) 



3 J {f3 + n + kf-^ Un+j 



The common factor {(3 + n + k)'^"^ in eq. (7.1-7) was introduced in order to decrease the 
magnitude of the terms of the numerator and denominator sums, because otherwise overflow may 
happen too easily for larger values of k. 

A mild extension of the general Levin transformation, eq. (7.1-7), will also be considered: 



k\ ifS + n + jf-'-^ Sn+j 



k 

4'J(/3,s„,cc;„) = —^^ , fc,£,nGlNo. (7.1-8) 



i:(-i) 

j=0 



jJ {f3 + n + k)>'-^ un+j 
k\ (/? + n + i)'^-^-! 1 



jJ (/? + n + A;)'=-i Un+j 



For i = this transformation reduces to the general Levin transformation, eq. (7.1-7). An 
alternative representation for this generalization of Levin's sequence transformation can be derived 
with the help of eq. (2.4-8), 

An).^ ^ _ Afe{(n + ^)fe-^-i sjur,} 
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This relationship imphes that this generahzation of Levin's sequence transformation is exact 
for sequences of the following type: 

k-l 

sn = s + {P + nY LOn Cj/{f3 + n)^' , k,e,n elNo. (7.1-10) 

j=0 



7.2. Recursive computation of the Levin transformation 

Another advantage of Sidi's approach [56] for the derivation of nondeterminantal expressions 
for Levin's sequence transformation is that starting from eq. (7.1-6) Fessler, Ford, and Smith [57] 
could derive a recursive scheme which allows a convenient computation of both the numerator and 
the denominator of the general Levin transformation, eq. (7.1-7). In eq. (7.1-6), both numerator 
and denominator are of the general form 

Pjr^ iP) = A'^ (/?) , fe, n e INo . (7.2-1) 

As usual, it is assumed here that the difference operator A as well as the shift operator E, 
which is defined in cq. (2.4-4), act only upon n and not upon k. Comparison with eq. (7.1-6) 
shows that the quantities xj^^\p) satisfy the following 2-term recursion in k: 

4")(/3) = (/3 + n)4^\(/3), k>l, n>0. (7.2-2) 

The following commutator relationship can be proved by complete induction with respect to k 
[57], 

A'=(/3 + n) - (/3 + n)A^ = kEA^-^ . (7.2-3) 
Combination of eqs. (2.4-4), (7.2-1), (7.2-2), and (7.2-3) yields: 

Pt\l^) = {kE + {(3 + n)A}A''-^xjrMp) (7.2-4) 
= {kE + ip + n)A}pj::^\iP) (7.2-5) 
= {P + n + k)Ptf^ iP) -{P + n)Pi% iP) . (7.2-6) 

With the help of the 3-term recurrence formula (7.2-6) the numerator as well as the denominator 
of the general Levin transformation >c[,"^(/3, s„, cj^) can be computed for k>l. However, for the 
sake of numerical stability and in order to make overflow less likely it is preferable to scale the 
quantities P^f^ (/3) by defining 

4") (/3) = p(") {P)/{p + n + kf-' . (7.2-7) 

Inserting this into eq. (7.2-6) yields the following 3-term recurrence formula for the scaled 
quantities L^^\p): 

4"i(« = 4"^"(« - 4"'(« , e Bo . (7.2-8) 

If we use the starting values 

L^^\P) = Sn/con, neJNo, (7.2-9) 
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the recurrence formula (7.2-8) produces the numerator of the general Levin transformation, eq. 
(7.1-7) and if we use the starting values 

4")(/3) = l/a;„, nGlNo, (7.2-10) 

we obtain the denominator of the general Levin transformation. 

With the help of the 3-term recurrence formula (7.2-8) it is also possible to compute both 
the numerator and the denominator of the generalized Levin transformation, eq. (7.1-8). If the 
starting values 

= + nY^n\ , An G INo , (7.2-11) 

are used, eq. (7.2-8) produces the numerator of the transformation (7.1-8), and the starting values 

4")(/3) = ll[{(3 + nYujn], AnGlNo, (7.2-12) 

produce the denominator of the transformation (7.1-8). 

The 3-term recurrence formula (7.2-6) was according to the knowledge of the author first 
published by Longman [58]. However, Longman's derivation of the recurrence formula (7.2-6) 
is based upon Sister Celine's technique [59] and not on properties of the difference operator A as 
the derivation by Fessler, Ford, and Smith [57]. 

7.3. Remainder estimates for the Levin transformation 

Until now, we have completely ignored the sequence {[cu„]}^ of remainder estimates and its role 
in the process of convergence acceleration or summation. In order to deal with this question we 
take into account that the elements of the model sequence (7.1-1), for which the general Levin 
transformation is exact, can be obtained from the elements of the sequence (7.1-2) by truncating 
the asymptotic power series in l/(/3 + n) after the first k terms. 

This indicates that the Levin transformation (7.1-7) should work very well for a given sequence 
{[sn]} if the sequence {[wn]} of remainder estimates is chosen in such a way that ujn is proportional 
to the dominant term of an asymptotic expansion of the remainder r„, 

rn = Sn-s = ujn[c + 0(rr^)\, n — >■ OO . (7-3-1) 

Now, one is confronted with the practical problem of finding such a sequence {[tUn]} of remainder 
estimates for a given sequence {[sn]}. Here, it must be emphasized that a sequence {[a;„]} of remain- 
der estimates is not determined uniquely by the asymptotic condition (7.3-1). Consequently, it 
should at least in principle always be possible to find a variety of different sequences of remainder 
estimates which all satisfy eq. (7.3-1). 

In some exceptional cases it is possible to derive explicit analytical expressions for the remainder 
estimates ujn which satisfy eq. (7.3-1) - for instance if the Sn are partial sums of a series and if 
the series terms have a sufficiently simple analytical structure. If such an explicit expression 
for LVn is used in eq. (7.1-7), the general Levin transformation is a /inmr sequence transformation. 

However, in most practical applications no information about the analytical structure of the 
sequence of remainders {[r„]} will be available and only the numerical values of a relatively small 
number of sequence elements Sm-, Sm+i-, ■ ■ ■ ■> Sm+e will be known. Consequently, it is necessary to 
find a way of obtaining the sequence of remainder estimates {[i^n]} directly from the numerical 
values of the elements of the sequence {[s,i]}. If such a sequence of remainder estimates is used 
in eq. (7.1-7), the Levin transformation is a nonlinear sequence transformation because each 
remainder estimate cOm depends explicitly upon at least one element of -Jsn]}- 
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On the basis of purely heuristic arguments Levin [28] suggested for sequences of partial sums 

n 

Sn = ^2^"' nGlNo, (7.3-2) 

i/=0 

some simple remainder estimates which according to experience nevertheless work remarkably 
well. In the case of logarithmic convergence, i.e., if the elements of the sequence of partial sums 
Sji satisfy 

lim f!i±i^ = 1, (7.3.3) 

n->oo Sn — S 

Levin [28] suggested the remainder estimate 

Un = iP + n)an, nGlNo. (7.3-4) 
The use of this remainder estimate in eq. (7.1-7) yields Levin's u transformation: 

f-, ' \jj iP + n + kr-^ an+j 

4") (/?,.„) = '-^ — . (7.3-5) 

^ [k\ (/j + n + j^-^ J_ 

h iP + n + k)>^-^ an+j 

In the case of alternating series Levin [28] suggested the remainder estimate 

LUn = an, n G INo . (7.3-6) 
This gives Levin's t transformation: 

'k\ (/3 + n + j)*^-i Sn+j 



triP^^n) = . (7.3-7) 

a\ ip + n+j)''-^ 1 



E(-i) 

j=0 



jJ (/3 + n + fc)*=-i a„. 



However, Smith and Ford [29] rightly remarked that the best simple remainder estimate for a 
convergent series with strictly alternating terms ai, would be 

LOn = a„+i , n G INo . (7.3-8) 

Using this in eq. (7.1-7) gives Smith and Ford's [29] modification of Levin's t transformation: 

^k\ (/3 + n + i)^-i Sn+j 



E(-i) 



, , ._n J J {f3 + n + k)'' 1 an+j+i 
dt\P,Sn) = '-^ . (7.3-9) 

(/3 + n + j)'-' 

j=0 



jJ {P + n + kY ^ an+j+i 



As a third simple remainder estimate Levin [28] suggested 



a;„ = """"+^ , n G INo . (7.3-10) 
an — an+1 
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Comparison with eq. (5.1-6) shows that this remainder estimate is based upon Aitken's 
process. It gives Levin's v transformation: 

\^ C_iV (/? + n + j)^-^ an+j - an+j+i 

vt'\P,Sn) = . (7.3-11) 

^ (^\ (/? + ^ + j) Qn+j - Qn+i+l 

j=0 



jJ (P + n + k)'' 1 an+jUn+j+i 



The remainder estimates (7.3-4), (7.3-6), (7.3-8), and (7.3-10) can also be used if the sequence 
{[s„]}, which is to be transformed, is not a sequence of partial sums. It is only necessary to replace 
in eqs. (7.3-5), (7.3-7), (7.3-9), and (7.3-11) ao by sq and a„ with n > 1 by Asn-i- 

Levin's remainder estimates (7.3-4), (7.3-6), and (7.3-10) as well as Smith and Ford's mod- 
ification (7.3-8) were derived using simple heuristic arguments. However, experience indicates 
that these remainder estimates nevertheless give rise to very powerful sequence transformations 
[29,30,57,60-64]. 

In some cases a more rigorous derivation of the remainder estimates mentioned above can be 
given. For instance, in Wimp's book (see p. 19 of ref. [23]) it is shown that if the terms an of a 
series satisfy 

On - A"n®|ao + — + ^ + --- I . n ^ oo , (7.3-12) 

with ao 7^ 0, then there exist constants Pj and 7j such that the remainders r„ of the partial sums 
of this series satisfy 



— — < ao -I ^ -o H ( ■, n^oo, (7.3-13) 

A — 1 n ' 



if |A| < 1, and 



^^-r|ao + - + ^ + --- I , n^oo, (7.3-14) 
B -I- 1 L n J 

if A = 1 and Re{e) < 1. 

A comparison of eqs. (7.3-12) and (7.3-13) gives us essentially the remainder estimate (7.3-6) 
which leads to the t transformation, eq. (7.3-7), and a comparison of eqs. (7.3-12) and (7.3-14) 
gives us essentially the remainder estimate (7.3-4) which leads to the u transformation, eq. (7.3-5). 

If we replace in the model sequence (6.1-6), for which the Richardson extrapolation scheme, eq. 
(6.1-5), is exact, x„ by l/{n + /?), we obtain the model sequence 

fc-1 

Sn = s + Y^ Cj/{n + py+^ , fe, n G INo . (7.3-15) 

j=0 

This model sequence can be obtained from the model sequence (7.1-2), for which Levin's 
sequence transformation, eq. (7.1-7) is exact, by choosing a;„ = l/{n + P). Hence, if we define 

Ai"^(/?,sn) = 4''^(/3,Sn,l/(n + /?)), /c,nGlNo, (7.3-16) 

we see that that the sequence transformation K^^\p, Sn) is obviously exact for the model sequence 
(7.3-15). If we now use eq. (7.1-6), we see that the transformation K^^\p, Sn) satisfies 

H'{P,Sn) = ^k(^n + P)'' ' ^'"^INo. (7.3-17) 



45 



The denominator in eq. (7.3-17) can be expressed in closed form. If we use (see p. 4 of ref. 
[65]) 

J2{-iy (^^iP + n + j)" = {-l)'k\, k,n eJNo, (7.3-18) 
together with eq. (2.4-8), we find: 

^^{n + (3f = k\. (7.3-19) 

Combination of eqs. (7.3-17) and (7.3-19) with eq. (2.4-8) gives us an explicit expression for 
this sequence transformation: 

Ai"^(/?,5n) = (-i)'E(-i)'^^r7^r4r^"+^' Kn^^o- (7.3-20) 

If we combine eq. (7.2-6) with eqs. (7.3-17) and (7.3-19), we can derive tlie following recursive 
scheme for the sequence transformation A^"''(/3, s„): 

k^^\p,Sn) =Sn, nelNo, (7.3-21a) 
ASi(Asn) = Ai"+'^(/?,^n+i) + (^AA^^\(3,Sn), A:, n G INq . (7.3-21b) 

This recursive scheme for the sequence transformation a["''(/3, s„) corresponds to the special 
case Xn = ^/{P + n) in the recursive scheme (6.1-5) which computes the Richardson extrapolation 
scheme with arbitrary interpolation points {[xn]}. 

A more complete discussion of the properties of the linear but nonrcgular sequence transfor- 
mation a["'^(/3, Sn) can be found in articles by Salzer [66, 67], Salzer and Kimbro [68], and Wimp 
[69] as well as in Wimp's book (see pp. 35 - 38 of ref. [23]). 

The sequence transformations ■u^"'''(/3, s^), eq. (7.3-5), and t^^\p,Sn), eq. (7.3-7), require the 
sequence elements s„_i, s„, s„+i, . . . , s„_l_fc for their computation, whereas d^, {P,Sn), eq. (7.3- 
9), requires the sequence elements Sn, Sn+i, ■ ■ ■ , Sn+k+i- Hence, they are all transformations 
of order A; -|- 1. The sequence transformation v^\l3, Sn), eq. (7.3-11), requires the sequence 
elements Sn-i, Sn, Sn+i, ■ ■ ■ , Sn+k+i which implies that it is a transformation of order k + 2. 
The linear sequence transformation A^^\f3, Sn), eq. (7.3-20), requires the sequence elements 
Sn, Sn+i, ■ ■ ■ , Sn+k, 1-6., it is a transformation of order k. 

The situation is somewhat different if the transforms with superscript n = are computed 
because then u^^\p,so) and t^^\p,so) are transformations of order k, whereas d^^\f3,so) and 
v^\p, So) are transformations of order A; -|- 1. 

7.4. Sidi's generalization of Levin's sequence transformation 

As discussed in section 6.1, the Richardson extrapolation scheme, eq. (6.1-5), is exact for model 
sequences of the following type: 

fc-i 

Sn = s + Cjxi^^ , k,n eJNo. (7.4-1) 

j=0 

The interpolation points ^Xn^ have to satisfy eq. (6.1-4). Very natural interpolation points for 
the Richardson extrapolation scheme are x„ = l/(n -|- /3) with /3 > 0. If this set of extrapolation 



46 



points is used in eq. (7.4-1) we obtain the model sequence (7.3-15) for which the sequence 
transformation A^"'^(/3, s„), eq. (7.3-17), is exact. This imphes that the Richardson extrapolation 
scheme (6.1-5) with the interpolation points x„ = l/(n -|- /3) is a special case of Levin's sequence 
transformation with a;„ = l/{n + P). 

However, the Richardson extrapolation scheme is also in some sense more general than Levin's 
sequence transformation since the interpolation points only have to satisfy eq. (6.1-4) but 

otherwise they are completely arbitrary. In Levin's sequence transformation it is tacitly assumed 
that the interpolation points always satisfy x^, = l/(ri + /?) with /3 > 0. 

Now, one can try to construct a sequence transformation which combines the advantageous 
features of the Levin transformation and the Richardson extrapolation scheme. This was ac- 
complished by Sidi [70] who constructed a sequence transformation, which he called generalized 
Richardson extrapolation process, on the basis of the following model sequence: 

fc-i 

Sn = s + ujn'^ Cjxi , fc, n G INTq . (7.4-2) 

j=0 

This model sequence combines the features of the model sequence (7.4-1) for the Richardson 
extrapolation scheme, eq. (6.1-5), since it contains arbitrary interpolation points and of 

the model sequence (7.1-1) for the Levin transformation, eq. (7.1-7), since it contains arbitrary 
remainder estimates 

For the construction of such a sequence transformation, which is exact for the above model 
sequence, eq. (7.4-2) is rewritten in the following way: 

k-l 

[Sn - s]/u;n = XI ^^^n ■ (7.4-3) 
j=0 

Obviously, the right-hand side of eq. (7.4-3) is a polynomial of degree /e — 1 in the variable 
Xn- Hence, the limit or antilimit s of this sequence can be determined if a linear operator can be 
found which annihilates the polynomial on the right-hand side of eq. (7.4-3). 

This annihilation of a polynomial can be accomplished with the help of divided differences which 
for instance occur in Newton's interpolation formula. A discussion of divided differences and their 
properties can be found in any book on numerical analysis or also in books on finite differences 
such as Norlund [71] or Milne-Thomson [72]. 

Let {[xn]} with n G JNq be a set of distinct interpolation points. Then the divided differences of 
orders 0,1, ... ,k,k + 1, .. . of a given function / are defined recursively by the relations 

f[Xn] =f{Xn), (7.4-4a) 

f[xn, Xn+k+i] = , A;, n G INo . (7.4-4b) 

Xfi+k+l Xji 

The divided differences . . . ,Xn+k] can also be expressed in closed form: 

f[Xn, Xn+k] = XI fi^n+j) f[ ^ , /c, n G INq . (7-4-5) 

j=0 i=0 ^"+» 

i¥=3 

It follows either from this expression or from the recursive scheme (7.4-4) that the divided 

differences f[xn, . . . , Xn+k] are linear functions of the initial values f{xn), ■ ■ -, /(xn+k)- I^i addition, 
it can be shown that if Pmix) is a polynomial of degree m in x, 

Pm{x) = Cq + CiX + C2X^ H h c^x"* , (7.4-6) 
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then all its divided differences with k> m satisfy 

Pm[Xn,---,Xn+k]=^, k>m. (7.4-7) 

The divided differences . . . , x^+fc] with k,n e INq can be identified with the elements 

A^^\f) of a 2-dimensional rectangular array. With this convention, the recursive scheme (7.4- 
4) for the computation of the divided differences of a given function / can be rewritten in the 
following way: 

=f{xn), neJNo, (7.4-8a) 
A^i.if) = ^ , k,n eJNo. (7.4-8b) 

Xn+k+l 

If we assume that two functions S{x) and n{x) of a continuous variable x exist, which coincide 
at the interpolation points Xn with s„ and a;„, respectively, 

S{Xn) = Sn, i^{Xn) = , (7.4-9) 

and which satisfy 

k-l 

[S{x) - s\/n{x) = CjxJ , (7.4-10) 

we see that we only have to compute the divided difference of order k for the left-hand side of eq. 
(7.4-10) at the interpolation points x„, . . . , Xn+k in order to obtain the limit or antilimit s. Hence, 
Sidi's generalized Richardson extrapolation process 7^^"^(sn, Wn)^:^) can be defined in terms of 
divided differences in the following way: 

It follows from eq. (7.4-8) that both numerator and denominator of this transformation can be 
computed with the help of the same 3-term recurrence formula: 

= th ^ , fc, n G INo . (7.4-12) 

If we use in eq. (7.4-12) the starting values 

= Sn/iOn, nGiNo, (7.4-13) 

we obtain the numerator of Sidi's generalized Richardson extrapolation process, eq. (7.4-11), and 
if we use the starting values 

= 1/iOn, nGiNo, (7.4-14) 

we obtain the denominator in eq. (7.4-11). 

Obviously, the Richardson extrapolation scheme (6.1-5) is a special case of Sidi's generalized 

Richardson extrapolation process 7?.^"''(s„,c<;„,a;„). To see this one only has to specialize Q{x) = 
x in eq. (7.4-11) which also implies LOn = Xn- 
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With this specialization, the Richardson extrapolation scheme (6.1-5) follows from eqs. (7.4-11) 
and (7.4-12). It is only necessary to compute the divided differences for 1/x at the interpolation 
points which can be done quite easily. The result is (see p. 8 of ref. [72]): 

1 (-1)^= 

- [Xn, Xn+k] = — • (7.4-15) 

-^n ■ ■ ■ -^n+k 

This implies that for a;„ = Xn the denominator of the generalized Richardson extrapolation 
process 7?.[."'^(s„,a;„,Xn) can be expressed in closed form. If we now set 

R^^ = Sn/Xn , (7.4-16) 

and 

j^in) ^ . . . Xn+kRt"^ , A;, n G INo , (7.4-17) 

we immediately obtain from eqs. (7.4-11) and (7.4-12) the Richardson extrapolation scheme, eq. 
(6.1-5). 

Further generalizations of Sidi's generalized Richardson extrapolation are possible. For instance, 
let us consider the following model sequence: 

m k^-1 

Sn = s + Y^ Jj'^ ^ xi , m, n, fc^ e INo . (7.4-18) 

//=0 j=0 

This model sequence contains m + 1 different sets of remainder estimates {[wi''^]}, . • - , {[wii"^]}. 
If we set m = in eq. (7.4-18), we obtain the model sequence (7.4-2) as a special case. 

Sidi [73] constructed a sequence transformation which is exact for the above model sequence. 
Originally, this sequence transformation was defined as the ratio of determinants, which is com- 
putationally quite unattractive. But recently. Ford and Sidi [74] could derive an algorithm which 
permits a recursive computation of Sidi's sequence transformation. 

From Sidi's very general sequence transformation [73], which is exact for the model sequence 
(7.4-18), other sequence transformations can be obtained by specializing the interpolation points 
{[x„]}. For instance, in earlier articles Levin and Sidi [75,76] had chosen the interpolation points 
according to the rule Xn = l/(n -|- 1) and had obtained a generalization of Levin's sequence 
transformation with several sets of remainder estimates. 

The typical feature of these sequence transformations is that they involve several sets of 
remainder estimates {[wi'^'']}, . . . , {[a;!'"'']}. Consequently, it is to be expected that these sequence 
transformations should be particularly powerful if sequences are to be accelerated which are 
superpositions of sequences with different convergence types. The numerical examples presented 
in the literature [74-76] confirm this opinion and it seems that the sequence transformations, 
which are based upon variants of the model sequence (7.4-18), are able to accelerate convergence 
even in cases in which other transformations fail. 

The power of these transformations stems from the occurrence of several different sets of re- 
mainder estimates. This is at the same time also the major disadvantage of these transformations. 
This may sound paradoxical. However, one should take into consideration that the popularity 
and the success of Levin's sequence transformation, eq. (7.1-7), is largely due to the fact that the 
simple remainder estimates (7.3-4), (7.3-6), (7.3-8), and (7.3-10) work remarkably well even in 
situations in which only the numerical values of a relatively small number of sequence elements 
Sm, ■ ■ ■ , Sm+e 8're known. If we would try to use in such a situation a sequence transformation, 
which is based upon a variant of the model sequence (7.4-18), we would first have to find a way of 
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determining numerically more than a single set of remainder estimates. Unfortunately, no simple 
and manageable theory is in sight which would yield more than a single set of remainder estimates 
if only the numerical values of a few sequence elements arc known. 

Consequently, if little or no information about the analytical behaviour of the remainders {[r^]} 
is available and if only a relatively small number of sequence elements Sm, ■ ■ ■ , Sm+e are known, it 
is normally not possible to use sequence transformations, which are based upon a variant of the 
model sequence (7.4-18), although they are potentially very powerful. The reason is that such 
a sequence transformation has too many degrees of freedom since it requires the input of m + 1 
different sets of remainder estimates {[wi'^^]}-, . . . , as well as a set of interpolation points 



In such a situation, one is more or less forced to use a simpler and probably also less efficient 
sequence transformation which, however, does not require such a detailed knowledge about the 
sequence to be transformed. 

7.5. Programming the Levin transformation 

In this section it will be discussed how the general Levin transformation (7.1-7) and its variants 
(7.1-8), (7.3-5), (7.3-7), (7.3-9), and (7.3-11) can be programmed efficiently. It is a typical feature 

of the general Levin transformation C^^\j3, Sn,ujn) and its variants that they can all be expressed 
as the ratio of two finite sums and that both the numerator and the denominator sum can be 
computed by the same 3-term recursion (7.2-8). 

Consequently, a program for the general Levin transformation or any of its variants has to 
compute simultaneously the numerator and denominator sums of the transformation. In the 
case of the general Levin transformation a program requires not only the input of the sequence 
elements Sn, but also the remainder estimates But otherwise, such a program should have 
essentially the same features as the subroutines EPSAL and AITKEN, which were described in 
sections 4.3 and 5.2, respectively. 

This means that such a program for the general Levin transformation should read in the 
sequence elements sq, si, . . ., Sm, ■ ■ ■ and remainder estimates coq, lvi, . . ., LOm, ■ ■ ■ successively, 
starting with sq and uq. After the input of each new pair Sm and Um as many new numerator 
and denominator sums of the Levin transformation (7.1-7) or its variants should be computed as 
possible. 

(n) 

The elements Lj^ (/3) , which either represent numerators or denominators of the general Levin 
transformation and which are computed with the help of the 3-term recurrence formula (7.2-8), 
can be arranged in a rectangular scheme in such a way that the superscript n indicates the row 
and the subscript k the column of the 2-dimensional array: 



The entries in the first column of the array are the starting values of the recursion. If the 
starting values l'^\(3) are chosen according to eq. (7.2-9), the 3-term recurrence formula (7.2-8) 




(7.5-1) 
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will produce a table L^"'* of numerators of the general Levin transformation, and if the starting 
values are chosen according to eq. (7.2-10), a table of denominators will be computed. The 3 
elements, which are connected by the linear 3-term recursion (7.2-8), form a triangle in the Levin 
table: 

This pattern implies that the recursion (7.2-8) has to proceed along counterdiagonals in the 
Levin table. Consequently, it is advantageous to rewrite the recurrence formula (7.2-8) in the 
following way: 



n>\ , l<j<n. (7.5-3) 



It also follows from the triangular structure of this recursion that the sequence elements 
So, si, . . . , Sm and the remainder estimates uqjUJi, ■ ■ ■ ,0Jm have to be known for the computation 
of all elements L^"'^^ with < n < m and Q <v <n oi the numerator and denominator tables. 
Since the transforms with the highest values of the subscript normally give the best results, our 
approximation to the limit s of the sequence {[sn]} to be transformed will be: 

{so Urn) ^ /:(^)(/3,so,a;o) , m G ]No . (7.5-4) 

Essentially this means that we shall use the following sequence of Levin transforms with minimal 
superscripts and maximal subscripts as approximations to the limit s: 

4°^(/3,so,a;o), cf\(5,so,uo), 6^\(5,so,uo), .... (7.5-5) 

Because of the triangular structure (7.5-2) of the recurrence formula (7.5-3) and since the 
computation proceeds along a counterdiagonal of the Levin table, a single 1-dimensional array will 
be sufficient for the computation of the L^J^~^\fi) which are either numerator or denominator sums 

of the general Levin transformation. For that purpose are stored in a 1-dimensional 

array £ in such a way that the superscript coincides with the index of the corresponding array 
element: 

L^^-''\(5) ^ t{n-v), n>0, 0<z/<n. (7.5-6) 

With this convention the recurrence formula (7.5-3) can be reformulated in terms of the elements 
of the array t. 

i{n -j) ^ £{n-j + l) (/? + n)J-i ~ ' 

n>l, l<j<n. (7.5-7) 

This computational scheme is simpler than the corresponding scheme for Wynn's e algorithm, 
eq. (4.3-10), since no auxiliary variables are needed here. 

Essentially the same approach works also in the case of the Richardson extrapolation scheme, 
eq. (6.1-5), or in the case of Sidi's generalized Richardson extrapolation process, eq. (7.4-11). For 
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instance, the recurrence formula (7.4-12) for Sidi's generalized Richardson extrapolation process 
can be rewritten in the following way: 

Rf~^^ = , n > 1 , 1 < i < n . (7.5-8) 

•'^n •'^n—j 

If the elements "'^ and the interpolation points x„ are stored in 1-dimensional arrays r and 
^ according to the rules 

^("-J) ^j.{n-j), n > , < i < n , (7.5-9) 
Xn ^^{n), n>0, (7.5-10) 

the recurrence formula (7.5-8) can be reformulated in terms of the elements of the arrays r and ^: 

^ •^ r{n-j + l) - r{n-j) ^^^ 

r{n-j)i — , n>l, l<j<n. (7.5-11) 

^(n) - ^{n-j) 

Similarly, the Richardson extrapolation scheme, eq. (6.1-5), can be rewritten in the following 
way: 

J^t\sn,xn) =Sn, n>0, (7.5-12a) 



■1^ j y^n—j^Xfi—j) — 



n>l, l<j<n. (7.5-12b) 

If the elements A/'J" ''\sn-j, Xn-j) and the interpolation points x„ are stored in 1-dimensional 
arrays A'' and ^ according to the rules 

M^''~^\sn-j,Xn-j) ^ N{n-j), n>0, 0<i<n, (7.5-13a) 
Xn -^^{n), n>0, (7.5-13b) 

the recurrence formula (7.5-12) can be reformulated in terms of the elements of the arrays N and 

N{n) <-Sn, n > , (7.5-14a) 
^^„_,^^ S(n-m(n-J^^)-J(n)N(n-J) _ 1 < , < „ . (7.5-14b) 

Obviously, the computational scheme (7.5-11) for Sidi's generalized Richardson extrapolation 
process and the computational scheme (7.5-14) for the Richardson extrapolation process are struc- 
turally identical with the computational scheme (7.5-7) for Levin's general sequence transforma- 
tion. This implies that programs for the Richardson extrapolation process and Sidi's general- 
ization of the Richardson extrapolation process would have the same features as a program for 
Levin's general sequence transformation. 

A program which computes the general Levin transformation (7.1-7) or any of its variants has 
to take precautions against an exact or approximate vanishing of the denominator sum. Again, 
this can be accomplished by introducing two variables HUGE and TINY which have values that 
are close to but not identical with the largest and smallest floating point number representable 
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on the computer. If the denominator sum of the transform Cin sq^loq) is smaUer in magnitude 
than TINY, then Cm\f3, so,(ji>o) wih be set equal to HUGE. This check is only necessary if the 
approximation to the limit according to eq. (7.5-5) is computed. 

The following FORTRAN 77 subroutine GLEVIN computes the numerator and denominator 
sum of the general Levin transformation {P, so,uo) with the help of the recurrence formula 
(7.5-3) in two 1-dimensional arrays ARUP and ARLO. It is safeguarded against an exact or 
approximate vanishing of the denominator sum by using the variables HUGE and TINY described 
above. The sequence elements s„ and the remainder estimates Un with n = 0, 1, 2, . . . have to be 
computed in a DO loop in the calling program. Whenever a new pair s„ and Un is computed in 
the outer DO loop this subroutine GLEVIN has to be called again and a new string of transforms 
Sn—j,uj,i—j) with < J < n is computed. The new sequence element s„ is read in via 
the variable SOFN, and the new remainder estimate ujn is read in via the variable ROFN. The 
approximation to the limit, which is given by the ratio ARUP(O) / ARLO(O), is returned via the 
variable ESTLIM. 

Again, it should be noted that GLEVIN only calculates the approximation to the limit according 
to eq. (7.5-4). The convergence of the whole process has to be analyzed in the calling program. 

Finally, it should be noted that the description of a FORTRAN IV program, which computes 
Levin's u transformation, eq. (7.3-5), with /? = 1, can be found in ref. [57]. 

SUBROUTINE GLEVIN (SOFN , ROFN , BETA , N , ARUP , ARLO , LARRAY , ESTLIM) 
DIMENSION ARUP (0 : LARRAY) , ARLO (0 : LARRAY) 

PARAMETER ( HUGE = l.E+60 , TINY = l.E-60 , ONE = l.EO ) 
ARUP(N) = SOFN / ROFN 
ARLO(N) = ONE / ROFN 
IF ( N .GT. ) THEN 

ARUP(N-l) = ARUP(N) - ARUP(N-l) 
ARLO(N-l) = ARLO(N) - ARLO(N-l) 
IF (N.GT.l) THEN 

BNl = BETA + FLOAT (N-1) 

BN2 = BETA + FLOAT (N) 

COEF = BNl / BN2 
DO 10 J = 2,N 

FACT = (BETA+FLOAT(N-J)) * C0EF**(J-2) / BN2 
ARUP (N- J) = ARUP(N-J+1) - FACT*ARUP (N- J) 
ARLO(N-J) = ARL0(N-J+1) - FACT*ARLO (N- J) 
10 CONTINUE 
END IF 
END IF 

IF (ABS (ARLO (0) ) .LT. TINY) THEN 

ESTLIM = HUGE 
ELSE 

ESTLIM = ARUP (0) /ARLO (0) 
END IF 
RETURN 
END 
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8. Sequence transformations based upon factorial series 
8.1. Factorial series 

In extensive numerical studies performed by Smith and Ford [29,30] and also in other articles [57, 
60 - 64] it was demonstrated that the general Levin transformation (7.1-7) and its variants (7.3-5), 
(7.3-7), (7.3-9), and (7.3-11) are remarkably powerful sequence transformations. Consequently, if 
one tries to derive alternative sequence transformations it should definitely be worthwhile to try 
to retain as many of the advantageous features of the Levin transformation as possible. 

It is the conviction of the author that the power of the Levin transformation is due to the 
fact that a sequence {[a;„]} of remainder estimates is explicitly included in the transformation. 
This is not necessarily an advantage because if the remainder estimates Un, which are used, are 
poor approximants of the actual remainders r^, the Levin transformation will lose much of its 
efficiency. However, if the remainder estimates are good approximants, it is likely that the Levin 
transformation will produce excellent results. 

In section 7.4, it was shown that Sidi's generalized Richardson extrapolation process (7.4-11) 
- which is also a generalization of Levin's sequence transformation - is by construction exact if 
the remainders r„ of the sequence to be transformed can be written as an remainder estimate a;„ 
multiplied by a polynomial of degree k — 1 in a;„, 

fc-i 

= ^^n XI ; /c, n G INq . (8-1-1) 

j=0 

The interpolation points Xn have to satisfy eq. (6.1-4) which means that they have to approach 
zero as n — > oo. If we choose in eq. (8.1-1) Xn = l/{n + P) we obtain the remainder of the 
model sequence (7.1-1) which is the basis for the construction of Levin's sequence transformation. 
Model sequences with remainders of the above type can be viewed to be finite approximations of 
sequence elements Sn which can be written as Poincare-type asymptotic expansions with respect 
to the asymptotic sequence -{[a;„a;^]} with n,j G INq, 

oo 

Sn ^ s + LOn ^ CjX^ , n — OO . (8-1-2) 

j=0 

Essentially this means that the sequence of remainder estimates {[a;„]} should be chosen in such 
a way that the ratio (s„ — s)/un can be written as an asymptotic power series in the interpolation 
points Ixn^, 

oo 

{Sn- S)/Un ^ ^Cjxl^, U ^ OO . (8.1-3) 

j=0 

If one tries to construct alternative sequence transformations, which also incorporate explicit 
remainder estimates via the auxiliary sequence {[ci;„]}, the simplest approach would be to replace 
the asymptotic power series on the right-hand side of eq. (8.1-3) by some other kind of expansion. 
This means that in eq. (8.1-3) instead of the powers ^xii^ some other asymptotic sequence 
-{[(^j(n)]} with n,j G JNq would have to be used. Consequently, it would be necessary to construct 
a transformation which is exact for the following class of model sequences: 

k-l 

Sn = s + ujn ^2 ^3^3^'"') ' A:,n G . (8.1-4) 

j=0 
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Such a transformation would also be a special case of the general extrapolation algorithm 
Ekisn), cq. (3.3-2), which was introduced by Brezinski [31] and Havie [32]. This follows immedi- 
ately if fj{n) in eq. (3.3-1) is replaced by uJnLpj{n). 

In principle, every set {[<^j(n.)]} of functions of n could be used in eq. (8.1-4) which satisfies 

ipo{n) = 1 , n e INo , (8.1-5a) 

(pj+i{n) = o{(pj{n)) , jGlNo, n ^ oo. (8.1-5b) 

However, such a minimal requirement on the set {[</'j(?^)]} would not suffice to make a new 
transformation practically useful, let alone to give it any advantage over already existing trans- 
formations. 

In order to be practically useful, a new sequence transformation should produce excellent 
numerical results in convergence acceleration and summation processes. Preferably, it should be 
as good as the Levin transformation or maybe even better. However, this would not be enough. 
Since the evaluation of large order determinants, as they for instance occur in eq. (3.3-2), is 
computationally very unattractive, a comparatively simple recursive scheme, which allows a fast 
and reliable computation of the transformation, would also be of considerable importance. The 
derivation of an explicit expression of the type of eq. (7.1-7) for the new transformation would 
also be desirable since this would give us a better chance of understanding the mechanism as well 
as the shortcomings of the new transformation. 

It is not a simple task to find an alternative asymptotic sequence other than powers ^oci,^ with 
n, j G INq which leads to a sequence transformation satisfying the requirements mentioned above. 
However, it will become clear later that a new class of sequence transformations with most of 
the advantageous features of the Levin transformation and some new ones can be derived quite 
easily if it is assumed that the ratio (s„ — s)/ujn is expressed as a factorial series and not as an 
asymptotic power series as in eq. (8.1-3). 

Let ^l{z) be a function which vanishes as \z\ —>■ oo. Then, a factorial series for n{z) is an 
expansion of the following type, 

oo 

n(z) = ^ + + _ % + ... = y-^. (8.1-6) 

z z{z + l) z{z + l)iz + 2) 

Here, {z)i,^i is a Pochhammer symbol which is commonly defined as the ratio of two gamma 
functions (see p. 3 of ref. [34]), 

(z)^+i = T{z + u + l)/r{z) = z{z + l)...{z + i^), z/GlNo. (8.1-7) 

Factorial series have a long tradition in mathematics. For instance, a large part of Stirling's 
book [5], which was published in 1730, deals with factorial series. In the nineteenth century the 
theory of factorial series was developed and refined by a variety of authors. A fairly complete 
survey of the older literature on this subject can be found in books by Nielsen [77] and Norlund 
[71] . In these two books good treatments of the fundamental properties of factorial series can be 
found. 

Factorial series have a remarkable property which will also be utilized quite profitably in this 
report: It is extremely simple to apply higher powers of the difference operator A to a factorial 
series. Consequently, factorial series play a similar role in the theory of difference equations 
as power series in the theory of differential equations. This explains why factorial series were 
often treated in the classical literature on finite differences, e.g., in books by Norlund [71,78] and 
Milne-Thomson [72]. 
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Quite interesting in the context of convergence acceleration and summation is also Borel's 
book on divergent series [79] in which the connection between factorial series and summability is 
emphasized. 

However, it seems that in recent years mathematicians have lost interest in factorial series. 
This can be concluded from the fact that only quite rarely references dealing with factorial series 
can be found in the more modern mathematical literature. Notable exceptions are a book by 
Wasow [80], which contains a chapter on factorial series, and an article by Iseki and Iseki [81] 
on remainder estimates of truncated factorial series. In the opinion of the author this declining 
interest in factorial series is quite deplorable because the numerical potential of factorial series 
has not yet been fully exploited. 

The fact, that the argument z of a factorial series occurs in Pochhammer symbols and not in 
the form of inverse powers as in asymptotic power series, has some far-reaching consequences for 
the convergence properties of factorial series. 

A power series converges in the interior of a circle which may coincide with the whole complex 
plane C or which may shrink to a single point as in the case of divergent asymptotic series. 
However, if a factorial series converges then according to Landau [82] it converges in a half-plane. 
This means that if a factorial series converges for some zq & € it also converges with the possible 
exception of the points z = 0, —1, —2, ... for all z G C with Re{z) > Re{zo). 

The different convergence properties of power series and factorial series are demonstrated quite 
drastically by the following two infinite series which both have the same numerical coefficients 
Cm = (-irm!: 



oo 



tXj it/ tXj 

m=0 

112 6 ^ (-l)™m! 

X {X)2 {X)3 [X)4 {X)m+1 

The power series diverges for all finite values of a; G IR, whereas the factorial series converges 
for all X > 0. 

Because of the different convergence properties of factorial and power series it may happen that 
a given function ^{z), which possesses a representation as a divergent asymptotic power series, 

c' c' c' 

5^(z) - ^ + ^ + ^ + ••• , z^oo, (8.1-10) 

possesses also a representation as a convergent factorial series according to eq. (8.1-6). 

The algebraic processes, by means of which the two series expansions (8.1-6) and (8.1-10) can 
be transformed into each other, were already described by Stirling [5] in 1730. A more modern 
description of Stirling's method can be found in Nielsen's book (see pp. 272 - 282 of ref. [77]). A 
detailed investigation of the problems associated with the transformation of an asymptotic series 
into a convergent factorial series can be found in a long article by Watson [83] . 

8.2. A factorial series analogue of Levin's transformation 

The following model sequence will be the basis for the new class of sequence transformations 
which will be discussed in this section: 

fc-i 

Sn = s ^- ujn^ Cj/{n + P)j , A:, n G INq . (8-2-1) 

j=0 
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This sequence is formally almost identical with the model sequence (7.1-1) which is the basis 
of the Levin transformation. The only difference is that the powers (n + (3y in cq. (7.1-1) are 
replaced by Pochhammer symbols {n + (3)j. Concerning the sequence {[cj„]} of remainder estimates 
it is again assumed that the are known functions of n which are different from zero and distinct 
for all finite values of n. But otherwise, the ujn are in principle completely arbitrary. 

The parameter f3 in eq. (8.2-1) is subject to the restriction that the Pochhammer symbols 
{n+(3)j must not be zero for all n, j € INq. This is certainly guaranteed if /? is not a negative integer 
or zero. However, the elements of the model sequence (8.2-1) will serve as finite approximations 
to factorial series of the following kind: 

oo 

Sn ~ S + OJn'^ Cj/{n + P)j , U ^ OO . (8.2-2) 

j=0 

In expansions of that kind negative values of P will lead to different signs of the terms of this 
factorial series if either n-|-/3<Oorn-|-/3>0 holds. Since the sign pattern of the terms of 
such a factorial series should not change as n increases, we see that as in the case of the Levin 
transformation the additional restriction /3 > is necessary. But otherwise, /3 is in principle 
completely arbitrary. 

In eq. (8.2-1) there occur A; -|- 1 unknown quantities, the limit or antilimit s and the k linear 

coefficients cq, . . . , c^-i. Hence, if A; -H 1 sequence elements s„, . . . , .s„+fc are known, the sequence 
transformation S^''\p, Sn,u^n) can be defined according to Cramer's rule by the following ratio of 
determinants: 











Un/iP + n)k-l . 


■ i^n+k/{P + n + k)k-i 


1 


1 


LUn 


<^n+k 


L0n/{(3 + n)k-l . 


. ujn+k/{f3 + n + k)k-i 



(8.2-3) 



If the sequence elements s„, . . . , s„+a; satisfy eq. (8.2-1), then obviously the sequence transfor- 
mation S^\p, Sn,ujn) is exact by construction, i.e.. 



(8.2-4) 



As in the case of the Levin transformation it would be desirable to find some alternative 
representation for the transformation S^\p, Sn,ujn)- Fortunately, this can be accomplished as 
easily as in the case of the Levin transformation. For that purpose eq. (8.2-1) is rewritten in the 
following way: 

fc-i 

{P + n)k-i[sn- s]/ujn = Cj {f3 + n + (8.2-5) 

3=0 

The highest power of n, which occurs on the right-hand side of eq. (8.2-5), is n''~^. Hence, if 
we apply the difference operator A'^ to eq. (8.2-5), the sum on the right-hand side, which is a 
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polynomial of degree A; — 1 in n, will be annihilated and we may conclude from eqs. (8.2-4) and 
(8.2-5) that the sequence transformation sj^\l3, s„,a;„) is given by the following ratio: 

^(n).. A^{{P + n)k^iSn/uJn} , . 

{{P + n)k-i/uJn} 

With the help of eq. (2.4-8) we obtain a representation of this transformation as the ratio of 
two finite sums: 



k 



E (-1)-' 



k\ iP + n + j)k-i Sn+j 



, , iP + n + k)k-i uJn+j 

5f ^ iP, sn, un) = , k,n eJNo. (8.2-7) 

^(_1)' iP + n + j)k-i 1 



jJ {P + n + k)k-i uJn+j 



The common factor (/? + n + k)k-i in eq. (8.2-7) was introduced in order to decrease the 
magnitude of the terms of the numerator and denominator sums, because otherwise overflow may 
happen too easily for larger values of k. 

The transformation (8.2-7) had already been treated by Sidi (see eq. (1.9) of ref. [84]) who 
used this as well as some other transformations for the derivation of explicit expressions for Pade 
approximants of some special hypergeometric series. However, it seems that Sidi did not consider 
the transformation (8.2-7) to be a sequence transformation in its own right. This is certainly an 
undeserved neglect. It will become clear later that the transformation (8.2-7) is very powerful. 
We shall see in section 13 that for divergent Stieltjes series, as they for instance occur in the 
perturbation expansion of the quartic anharmonic oscillator [3,85 - 88], it is certainly one of the 
most efficient summation methods which is currently known. 

As in the case of the Levin transformation, we also consider the following mild extension of the 
sequence transformation S^\p, s„,u;„): 



k 



k 

EM) 



k\ {P + n + i + j)k-£-l Sn+j 



, , {P + n + k)k-i Un+j 
S^J'liP, Sn, ujn) = , kj,n eJNo. (8.2-8) 



j=0 



k\ iP + n + i + j)k-e-i 1 



jJ {P + n + k)k-i uJn+j 



For i = this transformation reduces to the transformation sj^\p, Sn,uJn), eq. (8.2-7). An 
alternative representation for the generalized transformation (8.2-8) can be derived with the help 
ofeq. (2.4-8), 



^(n),. A''{{P + n + i)k-i-lSn/u;n} . . 

0;^^{P,Sn,UJn — . ffa , ] ■ (».2-yj 

A>'{{P + n + e)k^i^i /uJn} 

From this relationship we may deduce immediately that the transformation (8.2-8) is exact for 
model sequences of the following type: 

k-l 

Sn = s + {P + n)e LOn J2 + ' fe, ^, n G INo . (8.2-10) 

j=0 
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8.3. Recurrence formulas 

Next, it will be shown how the numerator and denominator of the transformation (8.2-7) can 
be computed recursively. It will turn out that virtually the same technique can be used as in 
the case of the Levin transformation. In eq. (8.2-7) both numerator and denominator are of the 
general form 

Q^^ (/?) = A*^ yi'^) {(5) , fc, n G INo . (8.3-1) 

As usual, it is assumed that the difference operator A as well as the shift operator E, which 
is defined in eq. (2.4-4), act only upon n and not upon k. The quantities Y^^\p) satisfy the 
following 2-term recursion in k: 

iP) = {P + n + k-2) iP), k>l, n>0. (8.3-2) 
Combination of eqs. (2.4-4), (7.2-3), (8.3-1) and (8.3-2) yields: 

q('^\P) = {kE + {f3 + n + k-2)A}A>''^Yi'::\iP) (8.3-3) 
= {kE+{(3 + n + k-2)A}Q'j^}^{l3) (8.3-4) 
= {/3 + n + 2k- 2)qK'^ {(3) - {/3 + n + k- 2)Qil\(/3) . (8.3-5) 

With the help of the 3-term recurrence formula (8.3-5) both the numerator as well as the 
denominator of sj^\p, Sn,u}n) can be computed for A; > 1. However, as in the case of the Levin 
transformation it is preferable to compute instead the scaled quantities 

-Sf (/3) = Q^^\f3) / (/? + n + k)k-i . (8.3-6) 

If we insert this into eq. (8.3-5), we obtain the following recurrence formula for the scaled 
quantities S^\p): 

If we use the starting values 

Si,^\p) = sn/con, neSNo, (8.3-8) 

the 3-term recursion (8.3-7) produces the numerator of the transformation (8.2-7), and if we use 
the starting values 

5j"^(/3) = 1/un, nelNo, (8.3-9) 

we obtain the denominator of the transformation (8.2-7). 

With the help of the 3-term recursion (8.3-7) it is also possible to compute both the numerator 
and the denominator of the generalized transformation (8.2-8). If the starting values 

Sj,''\p) = Sn/[W + n)eUn], e,neJNo, (8.3-10) 

are used, eq. (8.3-7) produces the numerator of the generalized transformation (8.2-8), and the 
starting values 

sJ")(/3) = + n)eu;n], e,nelNo, (8.3-11) 
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give the denominator of the transformation (8.2-8). 

Since the transforms with the highest values of the subscript normally give the best results, our 
approximation to the limit s of the sequence {[sn]} to be transformed will be the same as in the 
case of the Levin transformation, 

{■50 ^m} ^ S^\p,so,ujo) , m G INo . (8.3-12) 

Essentially this means that we shall use the following sequence of transforms with minimal 
superscripts and maximal subscripts as approximations to the limit s: 

S^''\p,so,uo), S?\p,so,iUo), Sj^\p,so,uo), .... (8.3-13) 

The recursive computation of the sequence transformation sj^\p, Sn,tOn) can be done in virtu- 
ally the same way as in the case of the Levin transformation. For that purpose it is recommendable 
to reformulate the 3-term recursion (8.3-7) in the following way: 

Sj iP) - S._, iP) - (^ + „ + _^-_2)(^ + ^ + ^-_3) ^i-i ' 

n>l, l<j<n. (8.3-14) 

As in the case of the Levin transformation, only a single 1-dimensional array will be needed 
for the computation of the 5^" "'^(/3) which are either numerator or denominator sums of the 

transformation (8.2-7). For that purpose the S^''''\P) are stored in a 1-dimensional array s in 
such a way that the superscript coincides with the index of the corresponding array element: 

Sl''~'"\p) s{n-i^), n>0, 0<z/<n. (8.3-15) 

With this convention the recursive scheme (8.3-14) can be reformulated in terms of the elements 
of the array s: 

, , {P + n-l)iP + n-2) 

s(n—i) <— sin— 1 + 1} — -y- -T-T- 7:7S(n — ']), 

^ y J I (/5 + „ + _^-_2)(^ + n + i-3) ^ 

n>l, l<i<n. (8.3-16) 



8.4. Explicit remainder estimates 

It still has to be discussed how the auxiliary sequence {[c^n]} in eq. (8.2-7) should be chosen. The 
simplest approach would be to proceed as in the case of the Levin transformation. There, it was 
argued that the auxiliary sequence should be chosen in such a way that uJn is proportional 

to the dominant term of the asymptotic expansion of the remainder 

rn = Sn- s = u!n[c + 0{n~^)] , n ^ oo . (8.4-1) 

Since the dominant term will not be affected if an asymptotic expansion is transformed into a 
factorial series or vice versa, it should be possible to use the same simple remainder estimates for 
sequences of partial sums as in the case of the Levin transformation. 
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Hence, the remainder estimate (7.3-4) will be used in eq. (8.2-7). This gives an analogue of 
Levin's u transformation, eq. (7.3-5): 

k 

V (-1V (/3 + n + j + l)fc_2 Sn+j 

, , ^ W W + n + k)k-i an+j 
yt\P^Sn) = ^ — ^ . (8.4-2) 



i=o ^-^^ 



k\ + n + j + l)k-2 1 



jj (P + n + k)k-i an+j 

In the same way, the remainder estimate (7.3-6) can be used in eq. (8.2-7). This gives an 
analogue of Levin's t transformation, eq. (7.3-7): 

^ 'k\ {f3 + n + j)k-i Sn+j 
, . ,_n kj) {l3 + n + k)k-i an+j 
rt^ iP, sn) = '-^ — ^ . (8.4-3) 



(_1)J f^^ iP + n + j)k 



jJ {P + n + k)k-i an+j 

The use of the remainder estimate (7.3-8) in eq. (8.2-7) gives an analogue of Levin's d 
transformation, eq. (7.3-9): 

k 

k\ {(3 + n + j)k-i Sn+j 



, , ,_n dJ (/? + + k)k-i an+j+i 

S^k\P,Sn) = ^ . (8.4-4) 

,. fk\ {(3 + n + j)k-i 1 



i=o ^-'^ 



jJ {P + n + k)k-i an+j+i 

Finally, the remainder estimate (7.3-10) gives an analogue of Levin's v transformation, eq. 
(7.3-11): 

, , ^ \j) iP + n + k)k-i an+jan+j+i 

^i"^(/3,^n) = . (8.4-5) 

C_iy A^ {P + n + j)k-i an+j - a«+j+i 
Vi/ iP + n + k)k-i an+jttn+j+i 

If one of the remainder estimates (7.3-4), (7.3-6), (7.3-8), and (7.3-10) is used in eq. (8.2-7), 
sj^\p, Sn,u}n) is a nonlinear sequence transformation. If, however, remainder estimates {[wn]} are 

used that do not depend explicitly upon the elements of the sequence {[sn]}, ^jf^iP, Sn,(^n) is a 
linear sequence transformation. 

Next, a factorial series analogue of the linear sequence transformation A^"^(/3, s„), eq. (7.3-20), 
will be constructed. A factorial series analogue of the model sequence (7.3-15), for which the 
sequence transformation A^"^(/3, s^) is exact, would be 

k-l 

Sn = s + ^ Cj/{n + a)j+i , k,n eJNo. (8.4-6) 

j=0 

This model sequence can be obtained from the model sequence (8.2-1), for which the sequence 
transformation (8.2-7) is exact, by choosing (3 = a + 1 and a;„ = l/{n + a). Hence, if we define 

.7^f)(a,s„) = 4"^(a + l,s„,l/(n + a)), A;,nGlNo, (8.4-7) 
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we see that that the sequence transformation ^^"^ (a, s„) is obviously exact for the model sequence 
(8.4-6). If we now use eq. (8.2-6), we see that the transformation T^\a, Sn) satisfies 

(«' «n) = ^k(^n + a)k ' ^' ^ e ^0 ■ (8.4-8) 

The denominator in eq. (8.4-8) can be expressed in closed form. We only have to use 

A''{n + a)k = k\. (8.4-9) 

This is a special case of the following general relationship which can be proved by complete 
induction in k, 

A" = (-1)' (i, - a). ^,^'° + "> . (8.4-10) 

1(0 + n) I (b + n + k) 

Combining eqs. (8.4-8) and ( 8.4-9) with eq. (2.4-8) gives us 

k 

^f^K^n) = i-i)'T.(-^y %^(k-if k,ne^o. (8.4-11) 

If we combine eq. (8.3-5) with eqs. (8.4-8) and (8.4-9), we obtain the following recursive scheme 
for the sequence transformation J^j^\a, Sn)'- 

J^^"'\a,Sn) =Sn, nGlNo, (8.4-12a) 
^S(a,sn)=^f^'^(«,sn+i) + "^^1^ A.^f)(a,.n), k,nelNo. (8.4-12b) 

The transformation T^^\a, s„) can be computed in essentially the same way as the Richardson 
extrapolation process. For that purpose it is recommendable to rewrite the above recursive scheme 
in the following way: 

T^^\a,Sn) =Sn, n>0, (8.4-13a) 

.^("-^■)(a,5„_,-)=^^-?^'^(«,^n-,+i) + ^^j^AJ^^l-'\a,Sn-j), 

n>l, l<j<n. (8.4-13b) 

If the ^j"^(a, Sn) are stored in a 1-dimensional array / according to the rule 

J^j"-^') (a, Sn-j) ^ f{n-j), n>0, 0<j<n, (8.4-14) 

we see that the recursive scheme (8.4-13) can be reformulated in terms of the elements of the 
array /: 

/(n) =Sn, n>0, (8.4-15a) 
f{n-j) = f{n-j + l) + -. A/(n-j), n>l, l<j<n. (8.4-15b) 

A discussion of the linear but nonregular sequence transformation J^^\a,Sn) can be found 
in Wimp's book (see pp. 38 - 40 of ref. [23]). However, the recursive scheme (8.4-12) for the 
computation of this transformation seems to be new. 
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The sequence transformations y^^ {j3,Sn), eq. (8.4-2), and t^^ {P, Sn), eq. (8.4-3), require the 

sequence elements s„_i, s„, Sn+i, . . . , s^-i-fc for their computation, whereas 6^^\p,Sn), eq. (8.4- 
4), requires the sequence elements Sn, Sn+i, ■ ■ ■ , Sn+k+i- Hence, they are all transformations 
of order A; -|- 1. The sequence transformation (/?^"^(/3, s„), eq. (8.4-5), requires the sequence 
elements Sn-i, Sn, Sn+i, ■ ■ ■ , Sn+k+i which implies that it is a transformation of order k + 2. 
The linear sequence transformation J^j^ {a,Sn), eq. (8.4-11), requires the sequence elements 
Sn, Sn+i, ■ ■ ■ , s„_|_fc, i.e., it is a transformation of order k. 

The situation is somewhat different if the transforms with superscript n = are computed 
because then y^\p,so) and Tj^\p,SQ) are transformations of order k, whereas 6^\p,sq) and 
(p^^\p, So) are transformations of order k + 1. 
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9. Other generalizations of Levin's sequence transformation 

9.1. Asymptotic approximations based upon Pochhammer symbols 

In the last section it was demonstrated how a new class of sequence transformations can be 
derived in exactly the same way as the Levin transformation which is generally accepted to be a 
very powerful convergence acceleration and summation method [29,30,57, 60-64]. 

The only difference between the Levin transformation and the new transformation discussed in 
the last section is that the Levin transformation assumes that the ratio / ujn can be expressed as 
an asymptotic power series whereas the new transformation assumes that rn/ujn can be expressed 
as a factorial series. Consequently, the analytical expressions for the various Levin transformations 
and those for the analogous variants of the new transformation can easily be transformed into 
each other. For instance, one only has to replace the powers {l3+n+j)'^~^ in the expression for the 

general Levin transformation C^^\p, Sn,u}n), eq. (7.1-7), by Pochhammer symbols {P + n + j)k-i 
in order to obtain the analogous new transformation sj^\f3, Sn,uJn), eq. (8.2-7). 

However, these new transformations, which were discussed in the last section, do not yet exhaust 
all possibilities of constructing other simple generalizations of the Levin transformation, which 
nevertheless retain most of the advantages of the Levin transformation. For instance, in recent 
articles on large order perturbation theory asymptotic approximations of the following general 
type were considered [89-91]: 

z{z-l){z-2)...{z-n) 

(9.1-1) 

Superficially, such an expression looks very much like a truncated factorial series since the 
argument z occurs also in Pochhammer symbols. However, the fact that the Pochhammer symbols 
in eq. (9.1-1) are of the type 

(-z)^+i = {-z){-z + l)...i-z + iy) 

= {-iy+^z{z -l)...{z-iy), ueJNo, (9.1-2) 

has some far-reaching consequences. For instance, if z is a positive real number, eq. (9.1-1) makes 
sense only if z > n holds. For n > z, either the later terms in the sum will show irregular sign 
patterns, or, if z happens to be a positive integer, some Pochhammer symbols will then be zero. 
Consequently, for a fixed value of z the summation limit n in eq. (9.1-1) cannot be extended to 
infinity, and such an expression cannot be considered to be the truncation of an asymptotic series 
after a finite number of terms. Instead, an expression such as eq. (9.1-1) has to be interpreted to 
be some kind of asymptotic approximation involving only a finite number of terms. 

The author is not aware of any reference in the mathematical literature, in which expressions 
like the one in eq. (9.1-1) are treated and their properties arc analyzed. Consequently, the 
material in this section is somewhat experimental and its mathematical basis is not as solid as in 
the other sections. 

However, it must be emphasized that these objections do not exclude the possibility that finite 
sums of the type of eq. (9.1-1) may yield excellent approximations if suitable restrictions on z 
and n are made. We shall see later in section 13 that sequence transformations which are based 
upon asymptotic approximations of the type of eq. (9.1-1) are indeed able to produce excellent 
results in convergence acceleration and summation processes. 



^ Co Cl C2 

^ z z{z-l) z{z-l){z-2) 

n 



+ ... 



V (-1)''+^ - 
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9.2. New sequence transformations based upon Pochhammer symbols 

The following model sequence will be the basis for the new class of sequence transformations 
which will be derived in this section: 

fe-i 

Sn = s + Un'^ Cj/{-j - n)j , k,n eJNq. (9.2-1) 

j=0 

This sequence is formally almost identical with the model sequence (8.2-1). The only difference 
is that the Pochhammer symbols (n -|- P)j in eq. (8.2-1) are replaced by Pochhammer symbols 
(—7 — n)j. Concerning the sequence {[cj„]} of remainder estimates it is again assumed that the oon 
are known functions of n which have to be different from zero and distinct for all finite values of 
n. But otherwise, the are in principle completely arbitrary. 

The parameter 7 in eq. (9.2-1) is not only subject to the restriction that the Pochhammer 
symbols (—7 — n)j must not be zero for all admissible values of n and j. Also, the regular sign 
pattern of the Pochhammer symbols in eq. (9.2-1) must not be destroyed. These two restrictions 
suggest that 7 should be a positive number satisfying 7 > A; — 1. 

In eq. (9.2-1) there occur A; -|- 1 unknown quantities, the limit or antilimit s and the k linear 
coefficients cq, . . . , Ck-i- Hence, if -|- 1 sequence elements s„, . . . , Sn+fc are known, the sequence 
transformation 7W^"'*(7, s„, a;„) can be defined according to Cramer's rule by the following ratio 
of determinants: 



1 

UJr,. 



(^n+k 

^n+k/{-l -n- k)k-l 



1 

i^n+k 



(9.2-2) 



Wn+fe/(-7 -n- k)k-i 
2-1), then obviously the sequence transfor- 



i^n/{-7 - n)k-i 
If the sequence elements s^, . . . , Sn+fc satisfy eq. (9. 
mation M^^\'j, Sn,Oi>n) is exact by construction, i.e., 

M^^\^,sn,u;n) = s. (9.2-3) 

Again it would be desirable to have some alternative representation for the transformation 

A4^i^\'y, Sn,u}n)- Fortunately, this can be accomplished quite easily. For that purpose eq. (9.2-1) 
is rewritten in the following way: 



fc-i 



{-J - n)k-l[Sn - s]/uJn = Cj -n + j)k-j-l. 

j=0 



(9.2-4) 



The highest power of n, which occurs on the right-hand side of eq. (9.2-4), is n^~^. Hence, if 
we apply the difference operator A'^ to eq. (9.2-4), the sum on the right-hand side, which is a 
polynomial of degree A; — 1 in n, will be annihilated and we may conclude from eqs. (9.2-3) and 
(9.2-4) that the sequence transformation M.^^\p, Sn,i^n) is given by the following ratio: 

A'^ {(-7 - n)k-l Sn/uJn} 



A'={(-7 - n)k-i/ujn} 



(9.2-5) 
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If we use eq. (2.4-8), we see that this transformation can be represented as the ratio of two 
finite sums: 

(-7 - n- j)k-i Sn+j 
, . VJ7 {-J-n- k)k-i uJn+j 
Mf\^,sn,u;n) = , A;,nG]No. (9.2-6) 

3=0 



jj -n- k)k-i UJn+j 



The common factor (—7 — n — k)k-i in eq. (9.2-6) was introduced in order to decrease the 
magnitude of the terms of the numerator and denominator sums, because otherwise overflow may 
happen too easily for larger values of k. 

As in the previous sections, we also consider a mild extension of the sequence transformation 

-^i"^(7,'Sn,Wn): 

k 

k\ - n- j + e)k-e-i Sn+j 



^ (_l)i f''\ i-'-'-'-J + Ok-t-i 1 

■i—n \3 / 



■_ \j J (~7 — n — k)k-i ^n+j 
(7, Sn,0Jn) = '-^ ^— ■ — , A;, ^, n G INo . (9.2-7) 



(-7 - n - k)k-i uJn+j 

J " 

For £ = this transformation reduces to the transformation A4^"'^(7, s„, u;„), eq. (9.2-6). An 
alternative representation for the generalized transformation (9.2-7) can be derived with the help 
ofeq. (2.4-8), 

^^'^ ""^ - An(-7-n + ^).-,-iK} • 

Prom this relationship we may deduce immediately that the transformation (9.2-7) is exact for 
model sequences of the following type: 

k-l 

Sn = s + {-J - n)eLOn'^ Cj/{-j - n)j , k,£,ne'iNo. (9.2-9) 

j=0 



9.3. Recurrence formulas 

Next, it will be shown how the numerator and denominator of the transformation (9.2-6) can 
be computed recursively. It will turn out that virtually the same technique can be used as in 
sections 7.2 and 8.3. In eq. (9.2-6) both numerator and denominator are of the general form 

4")(7) = A*^Z(")(7), fc,nGlNo. (9.3-1) 

As usual, it is assumed that the difference operator A as well as the shift operator E, which 
is defined in eq. (2.4-4), act only upon n and not upon k. The quantities Z^\'j) satisfy the 
following 2-term recursion in k: 



4"^(7) = (-7-n + A:-2)4!.\(7), A: > 1 , n>0. 



(9.3-2) 
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Combination of eqs. (2.4-4), (7.2-3), (9.3-1) and (9.3-2) yields: 

<^(7) = {(-7 - n + - 2)A - fcE}A^-iza(7) (9.3-3) 
= {(-7-n + A;-2)A-A;E}4"Ji(7) (9-3-4) 
= (7 + n - + 2)4"_\ (7) - (7 + n + 2)i?S'^ (7) • (9-3-5) 

With the help of the 3-term recurrence formula (9.3-5) both the numerator as well as the 

denominator of the transformation Ai^^\'y,Sn,uJn) can be computed for k > 1. However, it is 
again preferable to compute instead the scaled quantities 

^^"^(7) = ^^7) / (-7 - n - k%_i - (9-3-6) 

If we insert this into eq. (9.3-5), we obtain the following recurrence formula for the scaled 
quantities M^\'y): 

<i(7) = m("+^)(7) - lllllll m(")(7) , k,n>0. (9.3-7) 
If we use the starting values 

^^"^(7) = Sn/un , neJNo, (9.3-8) 

the 3-term recursion (9.3-7) produces the numerator of the transformation (9.2-6), and if we use 
the starting values 

M^'^Hl) = V^n, neJNo, (9.3-9) 

we obtain the denominator of the transformation (9.2-7). 

With the help of the 3-term recursion (9.3-7) it is also possible to compute both the numerator 
and the denominator of the generalized transformation (9.2-7). If the starting values 

^^^'^7) = Sn/[i-7-n)iuJn], i,n elNo, (9.3-10) 

are used, the 3-term recursion (9.3-7) produces the numerator of the generalized transformation 
(9.2-7), and the starting values 

M^Hl) = l/[{—f-n)eUn], e,ne-5No, (9.3-11) 

produce the denominator of the transformation (9.2-7). 

Since the transforms with the highest values of the subscript normally give the best results, our 
approximation to the limit s of the sequence -{[sn]| to be transformed will be the same as in the 
previous two sections, i.e., 

{so,uJo;s-i,uJi;...;Sm,(^m} ^ M^^\j,so,uJo) , m G INq . (9.3-12) 

Essentially this means that we shall use the following sequence of transforms with minimal 
superscripts and maximal subscripts as approximations to the limit s: 

M^^\j,so,u;o), Mf\j,so,LJo), M!^Hj,so,u;o), ... . (9.3-13) 
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The recursive computation of the sequence transformations Al[."''(7, s„,u;„) can be done in 
virtually the same way as in the previous two sections. For that purpose it is recommendable to 
reformulate the 3-term recursion (9.3-7) in the following way: 

(7) = m(!7^+^) (7) - ^ + + ^ Mj:^) (7) , n>l, l<j<n. (9.3-14) 

Again, only a single 1-dimensional array will be needed for the computation of the M^" "'''(7) 
which are either numerator or denominator sums of the transformation (9.2-6). For that purpose 

theMf-^')(7) are stored in a 1-dimensional array m in such a way that the superscript coincides 
with the index of the corresponding array element: 

^^""''^(t) rn{n - v) , n>0, 0<i/<n. (9.3-15) 

With this convention the recursive scheme (9.3-14) can be reformulated in terms of the elements 
of the array m: 

fn{n — j) <— m{n — j -|- 1) — -j- m(n — j) , n > 1 , 1 < j < n . (9.3-16) 



9.4. Explicit remainder estimates 

It still must be discussed how the auxiliary sequence {[a;„]} in eq. (9.2-6) should be chosen. The 
simplest approach would again consist of using the same simple remainder estimates for sequences 
of partial sums as in the case of the Levin transformation. 

Hence, if we use in eq. (9.2-6) the remainder estimate 

Un = {-j-n)an, (9.4-1) 
we obtain an analogue of Levin's u transformation, eq. (7.3-5): 

k 



{-l-n-j + l)fc-2 Sn+j 

, , \j7 (-7 - " - k)k-i an+j 
Yt\l,sn) = '-^ . (9.4-2) 

j=0 



jJ (_^ -n- k)k-i an+j 



In the same way, the remainder estimate (7.3-6) can be used in eq. (9.2-6). This gives an 
analogue of Levin's t transformation, eq. (7.3-7): 

k 

k\ (-7 - n - j)k-i Sn+j 



, , \jj {-7-n- k)k-i an+j 
Tt\l,sn) = '-^ . (9.4-3) 



(_iy (-1 -n- j)k-i 1 
^ U7 {-7-n-k)k-i an+j 
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The use of the remainder estimate (7.3-8) in eq. (9.2-6) gives an analogue of Levin's d 
transformation, eq. (7.3-9): 



k 

k\ (-7-"--j)fe-i Sn+, 



1 



Al"^(7,sn) = '-^ . (9.4-4) 

y (_i)i C") (-7-»-j)fc-i 1 

\jj {-l-n-k)k-i an+j+i 

Finahy, the remainder estimate (7.3-10) gives an analogue of Levin's v transformation, eq. 
(7.3-11): 



k 

'k\ (-7 -n- j)k-i an+j - an+j+i 



^1 (^'^-) = T— : ■ (9-4-5) 



i=o 



k\ (-7 -n- j)k-i an+j - a„- 



■i+i 



jJ - n - k)k-i ttn+jan+j+i 



If one of the remainder estimates (7.3-6), (7.3-8), (7.3-10), and (9.4-1) is used in eq. (9.2-6), 

A^^"^(7, Sn, cun) is a nonlinear sequence transformation. If, however, remainder estimates ^con^ 

are used that do not depend explicitly upon the elements of the sequence {[sn]}, M^j^\'j, Sn,i^n) 
is a linear sequence transformation. 

Next, an analogue of the Richardson extrapolation scheme (6.1-5) will be introduced which is 
based upon asymptotic approximations involving Pochhammer symbols of the type of eq. (9.1-1). 
For that purpose we consider the following model sequence: 

it-i 

Sn = s + Cj/{-C - n)j+i , k,n eJNo. (9.4-6) 

j=0 

This model sequence can be obtained from the model sequence (9.2-1), for which the sequence 
transformation (9.2-6) is exact, by choosing ^ = 7 -|- 1 and Un = — 1/(C + '^)- Hence, if we define 

V^^\C,Sn) = M'^^\C-l,Sn,-l/{n + 0), k,nelNo, (9.4-7) 

we see that that the sequence transformation vj^\Cj *n) is obviously exact for the model sequence 
(9.4-6). If we now use eq. (9.2-5), we see that the transformation pj^\Cj^n) satisfies 

(C, sn) = ' ^' - ^ . (9.4-8) 

The denominator in eq. (9.4-8) can be expressed in closed form. We only have to use 

A'X-C-n)fc = (-1)'=^!. (9.4-9) 

This is a special case of the following general relationship which can be proved by complete 
induction in k, 

A fc r(a - n) _ r{a-n- k) a m\ 
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Combination of eqs. (9.4-8) and ( 9.4-9) with eq. (2.4-8) yields 

T't\C,Sn) = E(-iy^47lS^^-+^' k,nelNo. (9.4-11) 
j=o ■'■ ■'>■ 

If we combine eq. (9.3-5) with eqs. (9.4-8) and (9.4-9), we obtain the following recursive scheme 
for the sequence transformation 'P^\c,,Sn)'- 

vtHCsn) =Sn, neJNo, (9.4-12a) 
'Pl%{C,Sn) = vt^'\C,Sn+i) + ^^Avi'HC,Sn), k,neJN,. (9.4-12b) 

The transformation vj^\c, Sn) can be computed in essentially the same way as the Richardson 
extrapolation process. For that purpose it is recommendable to rewrite the above recursive scheme 
in the following way: 

^o"^(C,Sn) =sn, n>0, (9.4-13a) 



n>l, l<j<n. (9.4-13b) 



If thePf^(C, Sji) are stored in a 1-dimensional array p according to the rule 

(C, Sn-j) ^ Pin-j), n > , 0<j<n, (9.4-14) 

we see that the recursive scheme (9.4-14) can be reformulated in terms of the elements of the 
array p: 

p{n) ^ Sn, n > , (9.4-15a) 

C -\- n — 2j -\- 1 

~ j) ~ J + 1) + Ap(n — j) 1 n>l, 1 < j < n . (9.4-15b) 

The sequence transformations Y^"'\'y,Sn), eq. (9.4-2), and T,["'-'(7, s„), eq. (9.4-3), require 

the sequence elements Sn—i,Sn,Sn-\-i,---iSn-\-k fo'^ their computation, whereas ^(Tj^^)) 6q. 
(9.4-4), requires the sequence elements s„, Sn+i, ■ ■ ■ , Sn+fc+i- Hence, they are all transformations 
of order A; -|- 1. The sequence transformation $^"^(7, s„), eq. (9.4-5), requires the sequence 
elements Sn-i, Sn, Sn+i, ■ ■ ■ , Sn+k+i which implies that it is a transformation of order k + 2. 
The linear sequence transformation 'pj^\c, Sn), eq. (9.4-11), requires the sequence elements 
Sn, Sn+1, . . . , Sn+k, i-^-, it is a transformation of order k. 

The situation is somewhat different if the transforms with superscript n = are computed 
because then Y^^\'j,so) and Tlf\'j,so) are transformations of order k, whereas a[°^(7, sq) and 
$[°^(7, So) are transformations of order A; -|- 1. 
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9.5. Drummond's sequence transformation 

Let us assume that Pk-i{n) is a polynomial of degree fc — 1 in n. We want to derive a sequence 
transformation X>^"^(s„,a;„), which is by construction exact for the following model sequence: 

Sn = s + UnPk-iin), fe,nG]No. (9.5-1) 

Concerning the sequence of remainder estimates it is again assumed that the a;„ are 

different from zero for all finite values of n, but otherwise they are in principle completely arbitrary. 
For the derivation of a sequence transformation, which is exact for the above model sequence, we 
rewrite eq. (9.5-1) in the following way: 

[sn - s]/ujn = Pk-i{n) , A:, n G INo . (9.5-2) 

Since Pk-i{n) is by assumption a polynomial of degree A; — 1 in n, the right-hand side of eq. 
(9.5-2) will be annihilated by the difference operator A'^. Hence, we can define the sequence 

transformation V^j^\sn,,oJn) by the following ratio: 

With the help of eq. (2.4-8) we obtain a representation of this transformation as the ratio of 
two finite sums: 

k 



V^^\sn,0Jn) = '-^ , k,n eJNo. (9.5-4) 



The special case Un = a-n of this sequence transformation was originally derived by Drummond 
[92]. Later, it was rederived by Sidi [84]. 

Both numerator and denominator of the sequence transformation (9.5-4) can be computed with 
the help of the following 3-term recurrence formula, which is an immediate consequence of eq. 
(9.5-3): 

<\ = 4"^'^-4"^ k,n>^. (9.5-5) 



If we use the starting values 



L>J"^ = Sn/i^n , neJNo, (9.5-6) 



the recurrence formula (9.5-5) produces the numerator of Drummond's transformation (9.5-4), 
and if we use the starting values 

L>S"^ = 1/cVn, nelNo, (9.5-7) 

we obtain the denominator of Drummond's transformation (9.5-4). 

Essentially the same computational algorithm, which was used for the other sequence transfor- 
mations of sections 7, 8, and 9 can also be used in the case of Drummond's sequence transfor- 
mation d["^(s„, u;„). Consequently, our approximation to the limit s of the sequence -{[s„]| to be 
transformed will be 

{so , cjq] Si, wi; . . . ; s^, iUm} ^ V^^^ {so, cjo), meJNo. (9.5-8) 
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This means that we shah again use a sequence of transforms with minimal superscripts and 
maximal subscripts as approximations to the limit s: 

vl^\so,u;o), V^^\so,u;o), vl^\so,u;o), .... (9.5-9) 

Since the recursive computation of the sequence transformation P^"^(s„,a;„) can be done in 
virtually the same way as in the case of the Levin transformation, it is recommendable to 
reformulate the recursive scheme (9.5-5) in the following way: 

L>("-^) = - D^^i'^ , n > 1 , l<j<n. (9.5-10) 

Again, a single 1-dimensional array will be sufficient for the computation of the quantities 
L>j""^'\ which arc cither numerator or denominator sums of the sequence transformation (9.5-4), 

if the are stored in a 1-dimensional array d according to the following rule: 

D^"-'') ^ d{n-u), n>0, (}<u<n. (9.5-11) 

With this convention the recurrence formula (9.5-10) can be reformulated in terms of the 
elements of the array d: 

d{n -j)^d{n-j + l)-d{n-j), n > 1 , l<j<n. (9.5-12) 

If we compare Drummond's sequence transformation 'D^\sn,uJn), eq. (9.5-4), with the ana- 
logous sequence transformations Sn,cOn), eq. (7.1-7), sj^\p, Sn,tOn), eq. (8.2-7), and 
A^^"^(7, s„,a;„), eq. (9.2-6), we see that the numerator and denominator sums of these transfor- 
mations contain additional n-dcpendent coefficients such as {P + n + {(3 + n + j)k-i, or 
(—7 — n — j)k-i, which are all of order 0{n^~^). 

Similarly, in the difference operator representation (9.5-3) for Drummond's sequence transfor- 
mation A'^ acts only upon Sn/oOn and l/cOn whereas in the analogous difference operator repre- 
sentations (7.1-6), (8.2-5), and (9.2-5) for the other transformations mentioned above weighted 
differences of Sn/con and l/tOn are formed. 

This implies that in the case of Drummond's sequence transformation, eq. (9.5-4), the se- 
quence elements s„, . . . , Sn+k and the remainder estimates a;„, . . . , ujn+k, which are needed for the 
computation of D^"^(s„, a;„), all contribute equally in the numerator and denominator sums. 

This is not true in the case of the other sequence transformations mentioned above since they 
contain additional weights. Essentially, this means that the information contained in the sequence 
elements and remainder estimates with larger indices will be emphasized more strongly in the 
computation of these sequence transformations. 

Since the later elements of a convergent sequence {[s„]} are usually closer to the limit s than 
the earlier elements, it seems plausible to expect that Drummond's sequence transformation, 
eq. (9.5-4), which does not give special weight to the sequence elements and remainder esti- 
mates with higher indices, should normally be somewhat less powerful than the transformations 

C^^\l3, SnjCOn), S^\p, Sn,ij^n)i and A^^""* (7, s„, a;„). We shall see later that this assumption is 
indeed normally true. 
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10. Brezinski's theta algorithm and related topics 



10.1. The derivation of Brezinski's theta algorithm 

It is well known that Wynn's e algorithm accelerates linear convergence quite efficiently and 
that it is also able to sum even wildly divergent series. However, the e algorithm is not able to 
accelerate logarithmic convergence. In the same way, Wynn's p algorithm is certainly one of the 
better accelerators for logarithmic convergence but fails to accelerate linear convergence and to 
sum divergent series. It would certainly be desirable to modify either the e or the p algorithm in 
such a way that the advantageous features of the e and the p algorithm could be combined. For 
that purpose, let us consider a recursive scheme of the following type: 

rl^ =0, T(S"^ = sn, (10.1-la) 

= T^lV^ + Wk D^^^ , k,n eJNo. (10.1-lb) 

(n) (u) 

Df, is a quantity which depends upon one or several other elements of the table of this 

(n) 

transformation. It is assumed that the functional form of is known. The quantity Wk is for 
the moment unspecified. Later, we will try to derive an expression for Wk which will guarantee 

that the above recursive scheme will lead to an acceleration of convergence. 

The recursive scheme (10.1-1) contains the e and the p algorithm as special cases. If we choose 
Wk = 1 together with 

^i"^ = ^(n+l)' (n) - ^'"^^0, (10.1-2) 

the recursive scheme (10.1-1) corresponds to Wynn's e algorithm, eq. (4.2-1), and if we choose 
Wk = 1 together with 

^'^' = ^SttFw^^ ^'"^^0, (10.1-3) 

^k ^k 

the recursive scheme (10.1-1) corresponds to Wynn's p algorithm, eq. (6.2-2). 

We now want to analyze how the quantity Wk has to be chosen in order to guarantee that the 

(n) 

sequence transformation will lead to an acceleration of convergence. 

In Wynn's e or p algorithm, only the transforms with even subscripts are used as approximations 
to the limit. The transforms with odd subscripts are only auxiliary quantities which diverge if 
the whole process converges. Since either the e or the p algorithm will be our starting point for 

(n) 

the construction of a new sequence transformation, we assume that behaves in the same way. 
This means that only the transforms with even subscripts will be used as approximations to the 
limit whereas the transforms with odd subscripts are only auxiliary quantities which diverge if 
the transforms with even subscripts converge. 

Brezinski [26] argued that the exact numerical values of the transforms with odd subscripts do 
not really matter as long as they diverge if the whole process converges. Consequently, the most 
convenient choice for W2k in eq. (10.1-lb) would be to proceed as in Wynn's e or p algorithm, i.e., 

u>2fe = l, fee Wo. (10.1-4) 

The parameters W2k+i can be determined by requiring that for fixed k G Mo the sequence 
{[-^21+2]} should converge more rapidly than the sequence {[T'2fc^^'']} following sense: 

lim =0, k€JNo. (10.1-5) 

^-^2k 
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If we form in eq. (10.1-lb) the first difference with respect to n, we see that condition (10.1-5) 
is automatically fulfilled if we choose 

W2k+i = - lim \ , kelNo. (10.1-6) 

n-*oo A ' 



rp{n) 


= 0, 




_ „ 


rp{n) 

-^2fe+l 


rp{n+l) 

~ ^2k-l 


+ D^i^ , 




rpin) 


rpin+l) 


j,in) 
(n) ^2fe+l' 
^^2k+l 


A;, n G INo 



Unfortunately, in situations of practical interest it will normally not be be possible to compute 
this limit n — > oo. As a manageable alternative, Brezinski [26] suggested to use instead: 

^j,in+l) 

<k+i = - ' fc, n G INo . (10.1-7) 

^^2k+l 

This choice together with eq. (10.1-4) leads to the following recursive scheme for the sequence 
transformation : 

(10.1-8a) 
(10.1-8b) 

(10.1-8c) 

k+l 

If we choose in this recursive scheme according to eq. (10.1-2) - which corresponds to 
Wynn's e algorithm - we obtain Brezinski's i? algorithm [26]: 

^L"^ =0, = sn, (10.1-9a) 

<Vi = + V[a4?] , (10.1-9b) 

As usual it is assumed that the difference operator A acts only upon the superscript n and not 
upon the subscript k. 

Brezinski's derivation of his ?? algorithm, which is based upon the the somewhat arbitrary 
choice (10.1-6), was purely experimental. However, it was certainly a very successful experiment. 
In numerical studies performed by Smith and Ford [29,30] it was demonstrated that Brezinski's 
"& algorithm is a very powerful as well as a very versatile sequence transformation since it is able 
to accelerate both linear and logarithmic convergence quite efficiently and to sum even wildly 
divergent series. 

Unlike most of the other sequence transformations in this report, Brezinski's ■& algorithm was 
not derived via a model sequence. In addition, the recursive scheme (10.1-9) is significantly more 
complicated than the recursive schemes of most other nonlinear sequence transformations. This 
should explain why only relatively little is known about the theoretical properties of Brezinski's 
■d algorithm. In his second book, Brezinski showed that the i? algorithm is invariant under 
translation according to eq. (3.1-4) (see p. 106 of ref. [20]). Also, Smith and Ford could prove 

that §2'^ accelerates linear convergence (see pp. 225 - 226 of ref. [29]). Short discussions of the 
properties of the 'Q algorithm can be found in books by Brezinski [19,20] and Wimp [23]. 

Inspired by the success of his ?? algorithm, Brezinski [27] suggested to use the approach, which 
led to the derivation of the 1? algorithm, also in the case of other sequence transformations. Since 
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Wynn's e algorithm - which is the starting point for Brezinski's t? algorithm - and Wynn's p 
algorithm are structurally almost identical, it is a relatively obvious idea to try to use Brezinski's 
concept for the construction of a new sequence transformation which would be based upon Wynn's 
p algorithm. This can be accomplished quite easily. One only has to insert eq. (10.1-3) instead 
of eq. (10.1-2) into eqs. (10.1-8b) and (10.1-8c) to obtain the following recursive scheme: 

e^^l = 0, ej") = s„, (lo.i-ioa) 



A©2it 



[Xn+2k+2 - Xn+l\ [AG^^'^J - [a;n+2fe+l - Xn\ [AG^^^/J 

k,n e INo- (10.1-lOc) 

(n) 

Numerical tests showed that this sequence transformation 0^ is more versatile than Wynn's 
p algorithm, from which it was derived, since it is able to accelerate linear convergence and 
to sum some divergent series. However, it is unfortunately much less efficient than Wynn's p 
algorithm in the case of logarithmic convergence, and it is also not particularly powerful in the 
case of linear convergence or divergence. This shows that in the case of Wynn's p algorithm 
Brezinski's experimental choice (10.1-6) does not lead to the same spectacular success as in the 

(n) 

case of Wynn's e algorithm since the resulting sequence transformation Qj, - although clearly 
more versatile than Wynn's p algorithm - is not able to compete with other, more specialized 
sequence transformations. 



10.2. Programming Brezinski's theta algorithm 



A program for Brezinski's i? algorithm should have the same features as the other programs 
described in this report. This means it should read in the sequence elements sq, si, . . . , Srrn • • • 
successively starting with sq. After the input of each new sequence element Sm as many new 
elements -d^^^ should be computed as is permitted by the recursive scheme (10.1-9). That new 

element which has the largest even subscript k, should be used as the new approximation to 
the limit of the sequence {[sn]}- 

Let us arrange the elements of the i} table in a rectangular scheme in such a way that the 
superscript n indicates the row and the subscript k the column of the 2-dimensional array: 

a{0) 
'n 

9(1) 
'n 

,(2) 
'n 

,(3) 



^0 




4' . 




^0 




4^ . 




^(2) 




4' . 




^(3) 




4' . 





^(n) ^(n) 



(n) 



(10.2-1) 



The entries in the first column of the array are the starting values 4'^^ — of the recursion 
according to eq. (10.1-9a). The remaining elements of the i? table can be computed with the 
help of the recurrence formulas (10.1-9b) and (10.1-9c). The 4 elements, which are connected by 
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the nonlinear recursion (10.1-9b), form the same pattern in the -d table as the 4 elements of the e 
table which are connected by eq. (4.2-lb): 

Att) An) 

An+l) An+1) {W.Z-Z) 

The 6 elements, which are connected by the nonlinear recursion (10.1-9c), form the following 
pattern in the i? table: 

"2k+l ^2k+2 

4r'^ (10.2-3) 

,a("+2) ,Q(n+2) 
'^2k ^2k+l 

These two patterns show that the recursions (10.1-9b) and (10.1-9c) have to proceed along a rel- 
atively complicated path in the table. Let us assume that the sequence elements sq, si, . . . , Sm-i 
had been read in and as many elements of the i? table had been computed as it is permitted by the 
recursive scheme (10.1-9). After the input of the next sequence element Sm the string ^('""I^-^/^I) 
with < j < [[(2m + l)/3]] can be computed. Again, [[x| stands for the integral part of x, i.e., the 
largest integer i/ satisfying v < x. In this context, it is recommendable to rewrite the recursive 
scheme (10.1-9) in the following way: 

=Sn, n>0, (10.2-4a) 
^('^-i) = _ ^("-1)] , n>l, (10.2-4b) 

^ ^(n^3.+l) ^ i 2,-2 ^ U_^^2,-l J ^ n > 3 , 1 < J < ^3] , (10.2-4c) 

4";?'"'^ = ^t-i^ + 1/[a4;-^^-^)] , n > 4 , J < tt(n - l)/3l . (10.2-4d) 

It follows cither from this recursive scheme or equivalently from the two geometric patterns 
(10.2-2) and (10.2-3) that for the computation of the transform if^k ^^"^ sequence elements 

Sn, Sn+i, • • • , Sn+3fc have to be known. Thus, i}2k ^ transformation of order i = 3k. 

The approximation to the limit will depend upon the index m of the last sequence element 
Sm which was used in the recursive scheme (10.2-4). If m is a multiple of 3, m = 3/x, our 
approximation to the limit will be the transformation 

{so,si,...,S3;.} ^ 4?, (10.2-5) 

if we have m = 3/1 + 1, our approximation to the limit will be 

{S1,S2,...,S3^+1} ^ (10.2-6) 
and if we have m = 3/1 + 2, our approximation to the limit will be 

{S2, S3,..., 53^+2} ^ (10.2-7) 

These three relationships can be combined into a single equation yielding 

/ 1 q("i-3[m/3|) /'1^oe^ 

lSm-3|[m/3l) Sm-3[m/3l+l) ■ ■ • ) Sm/ '^2[m/3l " (LU.Z-S) 
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Because of the complicated structure of the nonUnear recursive scheme (10.2-4) a single 1- 
dimensional array will not suffice for the computation of the new string ^^("■■"I^-'/^ll) with < j < 
|[(2n + l)/3] after the input of the last sequence element Sn- Two 1-dimensional arrays A and B 
together with three auxiliary variables will be needed. 

We shall use the convention that if the index n of the last sequence element s„, which was read 
in, is even, n = 2m, the new string will be stored in the array A according to the rule 

and if the index n of the last sequence element s„ is odd, n = 2m + 1, the new string will be 
stored in the array B according to the rule 

^(2m-l3j/2i+i) ^ ^^^.^ ^ < J < [(4m + 3)/3l . (10.2-10) 

Let us now assume that the index n of the last sequence element s„, which was read in, is 
even, i.e., n = 2m. Before the computation of the new string (10.2-9), which is to be stored in A, 
the array B contains the elements t?^-^"* Pj72]] i) ^.^j^ < j < |[(4m — l)/3]], whereas in A the 
elements ^(.2'"-I3j72I-2) ^^^^ 0<j< [(4m - 3)/3l are stored. The recursive scheme (10.2-4) can 
then be expressed in terms of the elements of the arrays A and B in the following way: 

^(0) ^S2m, mGlNo, (10.2-lla) 
^(1) ^l/[^(0)-S(0)], (10.2-llb) 
A(2,) ^ A' (2, - 2) + - 2) - A'{2j - 2)] [A{2j - 1) - B{2j - 1)] 

j < I2m/31 , (10.2-llc) 
A{2j + 1) ^ A'{2j - 1) + l/[B{2j) - A{2j)] , j < [(2m - l)/3l . (10.2-lld) 

The primed array elements A'{2j — 2) and A'{2j — 1) refer to the occupation of A after the 
computation of the string ^(2™- Pi/21 -2) ^^^^ < j < [(4m - 3)/3]]. Since these elements are 
overwritten during the computation of the new string, they have to be stored in auxiliary variables. 

Let us now assume that the index n of the last sequence element s„, which was read in, is odd, 
i.e., n = 2m + 1. This implies that the role of the two arrays A and B has to be interchanged. 
Before the computation of the new string (10.2-10), which is to be stored in B, the array A contains 
the elements ^(2m-l3j72l) ^.^j^ < j < [(4m + l)/3l, and in B the elements ^(2™-Pj/2l-i) ^j^^ 
< J < [(4m — 1)/3| are stored. The recursive scheme (10.2-4) can then be expressed in terms 
of the elements of the arrays A and B in the following way: 

B{Q) ^S2m+i, mGlNo, (10.2-12a) 

B{1) ^ 1/[B{0) - A{0)] , (10.2-12b) 

Fi(9,) ^R79.- o^ , [Ai2j-2)-B'i2j-2)][Bi2j-l)-A{2j-l)] 

B{2j) ^B{2j-2) + Bi2j-l)-2A{2j-l)+B'{2j-l) ' 

j < [(2m + 1)/31 , (10.2-12C) 
B{2j + 1) ^ B'{2j - 1) + l/[^(2i) - B{2j)] , j < [2m/3] . (10.2-12d) 

The primed array elements B'{2j — 2) and B'{2j — 1) refer to the occupation of B after the 
computation of the string ^(^"^"I^-'/^ll'"-'^) with < j < [(4m — l)/3]]. Since these elements are 
overwritten during the computation of the new string, they have to be stored in auxiliary variables. 
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The following FORTRAN 77 subroutine THETA performs the recursive computation of Brezin- 
ski's i3 algorithm in two 1-dimcnsional arrays A and B using the two recursive schemes (10.2-11) 
and (10.2-12). It is safeguarded against an exact or approximate vanishing of the denominators 

A'^'&^2j-i^ and A'd'-^-Zl^^^'^ ^ eqs. (10.2-4c) and (10.2-4d) by using two variables HUGE and 
TINY. The elements s„ with n = 0, 1, 2, . . . of the sequence to be transformed have to be com- 
puted in a DO loop in the calling program. Whenever a new sequence element s„ is computed in 
the outer DO loop, this subroutine THETA has to be called again and a new string 1?^" '^^-'/^^^ 
with < j < l{2n + 1)/3]1 will be calculated. The new sequence element s„ is read in via the 
variable SOFN and the approximation to the limit is returned via the variable ESTLIM. 

It is important to note that this subroutine THETA only calculates the approximations to 
the limit according to eqs. (10.2-5) - (10.2-7). The convergence of the whole process has to be 
analyzed in the calling program. 

On pp. 368 - 370 of Brezinski's second book [20] the hsting of a FORTRAN IV program, which 
computes Brezinski's •& algorithm using three 1-dimensional arrays, can be found. 



SUBROUTINE THETA (SOFN , N , A , B , LENGA , LENGB , ESTLIM) 
DIMENSION A(0:LENGA), B(0:LENGB) 
PARAMETER ( HUGE = l.E+60 , TINY = l.E-60 ) 
PARAMETER ( ZERO = O.EO , ONE = l.EO , TWO = 2.E0 ) 
JMAX = (2 * N + 1) / 3 
NM0D2 = M0D(N,2) 
IF (N.EQ.O) THEN 

A(0) = SOFN 

ESTLIM = SOFN 

RETURN 
END IF 

IF ( NM0D2 .EQ. 0) THEN 
AUX2 = ZERO 
AUXl = A(0) 
A(0) = SOFN 
DO 10 J = 1, JMAX 

AUX3 = AUX2 

AUX2 = AUXl 

IF ( J .LT. JMAX ) THEN 
AUXl = A (J) 

END IF 

IF ( M0D(J,2) .EQ. ) 
DENOM = A(J-l) - TWO 
IF ( ABS (DENOM) .LT. 

A (J) = HUGE 
ELSE 

A(J) = AUX3 + ( B(J-2) - AUX3 ) * ( A(J-l) - B(J-l) ) 
1 / DENOM 

END IF 
ELSE 

DIFF = A(J-l) - B(J-l) 

IF ( ABS (DIFF) .LT. TINY ) THEN 

A (J) = HUGE 
ELSE 



THEN 

* B(J-l) + AUX2 
TINY ) THEN 
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A (J) = AUX3 + ONE / DIFF 
END IF 
END IF 
10 CONTINUE 

IF ( M0D(JMAX,2) .EQ. ) THEN 

ESTLIM = A(JMAX) 
ELSE 

ESTLIM = A(JMAX-l) 
END IF 
ELSE 

AUX2 = ZERO 
AUXl = B(0) 
B(0) = SOFN 
DO 20 J = 1, JMAX 

AUX3 = AUX2 

AUX2 = AUXl 

IF ( J .LT. JMAX ) THEN 
AUXl = B(J) 

END IF 

IF ( MOD (J, 2) .EQ. ) THEN 

DENOM = B(J-l) - TWO * A(J-l) + AUX2 
IF ( ABS (DENOM) .LT. TINY ) THEN 

B(J) = HUGE 
ELSE 

B(J) = AUX3 + ( A(J-2) - AUX3 ) * ( B(J-l) - A(J-l) ) 
1 / DENOM 

END IF 
ELSE 

DIFF = B(J-l) - A(J-l) 

IF ( ABS (DIFF) .LT. TINY ) THEN 

B(J) = HUGE 
ELSE 

B(J) = AUX3 + ONE / DIFF 
END IF 
END IF 
20 CONTINUE 

IF ( MOD (JMAX, 2) .EQ. ) THEN 

ESTLIM = B(JMAX) 
ELSE 

ESTLIM = B(JMAX-l) 
END IF 
END IF 
RETURN 
END 
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10.3. The iteration of 4"' 

In section 5 it was shown how Aitkcn's algorithm, which according to cq. (5.1-5) is identical 

with €^2^ , can be iterated to give the sequence transformation ^[."^ • In the same way, it was shown 

in section 6.3 that can be iterated to give the sequence transformation W^"'*. In this section, 

we want to analyze how the transform -d^^^ can be iterated. From the recursive scheme (10.1-9) 
we obtain the following expression: 

An) _ ^ [As„] [Ag„+i] [A^s„+i] nnqn 

It follows from this relationship that '&^2^ ., which is a kind of weighted A^ process, is identical 
with Lubkin's W transformation [40]. Many other representations for 1^2"^ can be derived by 
suitable manipulations of eq. (10.3-1). Examples are: 

[As„+2] [A2 [As„] [A2s„+i] n^oo^ 

[A.„+2] [A2s„] - [As„] [A2s„+i] ^ ^ 

- A2[i/A.J • ^^"-^-^^ 

Comparison of eq. (10.3-3) with eqs. (2.4-8), (7.3-5), and ((9.5-4) shows that 1?^"^ is also a 
special case of Levin's u transformation or Drummond's sequence transformation with uJn+i = 
Asn: 

4")=4"+^)(A.n+i) (10.3-4) 
= p("+')(s„+i,Asn). (10.3-5) 

In addition, a comparison of eqs. (5.1-12) and (10.3-3) shows that 'd^^^ may also be considered 
to be a generalization of Aitken's A^ process. 

If we want to iterate eq. (10.3-1), we have to use the following recursive scheme: 

J^"^ = s„ , n G INo , (10.3-6a) 

As usual, the difference operator A acts only upon the superscript n and not upon the subscript 
k. It follows from this recursive scheme that for the computation of J'^^^ the sequence elements 

(n) 

Sn, Sn+1, ■ ■ ■ , Sn+3k have to be known. Consequently, JT): is a transformation of order 3A;. In 

(n) (n) 

that respect, J'^ ' is equivalent to •u)^^ which needs the same set s„, Sn+i; ■ ■ ■ 1 ^n+sfc of sequence 
elements for its computation. 

(11) 

In sections 13 and 14, we shall see that Tk > is a powerful sequence transformation which 

has similar properties as '&2k-> ^'-'^^ accelerate linear and logarithmic convergence 

and is also able to sum even wildly divergent series. This may be considered to be an indirect 
confirmation of the validity of Brezinski's choice (10.1-4) which is based upon the assumption that 

in) 

the exact numerical values of the transforms '&2k+\ '^ot really matter as long as they diverge 
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if the transforms t}'^ converge. If we would replace the 4-term recursion (10.1-9b) by the 3-term 
recursion 

= V[A<^] , k,n eJNo, (10.3-7) 



then with this modified -d algorithm we would obtain 



4? = Jt^ ■ (10.3-8) 



10.4. Programming the iterated theta algorithm 

(n) 

A program, which computes the sequence transformation , should have the same features 
as the other programs in this report. This means it should read in the sequence elements 
So, si, . . . , Sm, ■ ■ ■ successively starting with sq. After the input of each new sequence element 

(n) 

Sm as many new elements Jj^ ' should be computed as is permitted by the recursive scheme 

(10.3-6). That new element j'^^ ■, which has the largest subscript should be used as the new 
approximation to the limit of the sequence {[sn]}. 

Let us arrange the elements in a rectangular scheme in such a way that the superscript n 
indicates the row and the subscript k the column of the 2-dimensional array: 



^(0) 






^(0) 
Un 


^(1) 


J? 


J2 


Un 


^(2) 


J? 


^(2) 


^(2) 


^(3) 




^(3) 
02 


Un 



UQ "^1 "^i 



in) 



Jr 



(n) 



(10.4-1) 



(n) 

The entries in the first column of the array are the starting values JTq = of the recursion 
according to eq. (10.3-6a). The remaining elements of the J table can be computed with the 
help of the recurrence formula (10.3-6b). The 5 elements, which are connected by the nonlinear 
recursion (10.3-6b), form the following pattern: 



(n) 



J, 



in) 



k+1 



J, 



(n+1) 



(n+2) 
(n+3) 



(10.4-2) 



It was remarked earlier that may be considered to be a generalization of Aitken's A 

in) 

process. In the same way, the computational algorithm for the sequence transformation Jj^ ' is 

essentially a generalization of the computational scheme for Aitken's iterated process ji^^^ 
which was discussed in section 5.2. For that purpose, the recursive scheme (10.3-6) is rewritten 
in the following way: 



Uq — *r; 



n > 0, 



{n-U) 



(n-3£+l)n 



^^j{n-M+2)^ [A2 



{n-U)^ 
1 J 



n > 3 1 < ^ < [n/31 . 



(10.4-3a) 



(10.4-3b) 
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As usual, lx\ denotes the integral part of x, i.e., the largest integer u satisfying v < x. It follows 
either from the geometric pattern (10.4-2) or from this recursive scheme that after the input of a 
new sequence clement Sm the string with < fi < [[?ti/3| can be computed. 

Again, the approximation to the limit of the sequence to be transformed depends upon the 
index m of the last sequence element Sm which was read in. If m is a multiple of 3, m = 3fi, our 
approximation to the limit will be the transformation 

{so,si,...,S3m} ^ (10.4-4) 
if we have m = 3/i -I- 1, our approximation to the limit will be 

{si,S2,...,.S3m+i} ^ (10.4-5) 
and if we have m = 3fj, + 2, our approximation to the limit will be 

{S2, S3,..., 33^+2} ^ Jj'^ (10.4-6) 

With the help of the notation [[a;]] for the integral part of x these three relationships can be 
combined into a single equation yielding 

r 1 /7-("i-3[m/3|) /-in A '7^ 

lSm-3|[m/3l)'5m-3[m/3l+l)---)Smj- ^ •-^|[m/3l " 

The recursive scheme (10.4-3) - or equivalently the geometric pattern (10.4-2) - looks relatively 

complicated. But nevertheless, it is possible to perform the computation of the string 

with < £ < [n /3]] in a single 1-dimcnsional array J if the elements of the table of this sequence 

transformation are stored according to the following rule: 

Ji.n-'')^ n>(}, (}<u<n. (10.4-8) 

With this convention, the recursive scheme (10.4-3) can be reformulated in terms of the elements 
of the array J: 

J(n) ^Sn, n > , (10.4-9a) 
Tfrr,^ ^Um^U- [AJ(m)] [AJ(m + 1)] [AV(m + 1)] 

jynoj jyin^ ) [A J(m + 2)] [A2 J(m)] - [A J(m)] [A2 J(m 4- 1)] ' 
m = n-M, n>3, 1 < ^ < [[n/3| . (10.4-9b) 

The following FORTRAN 77 subroutine THETIT performs the recursive computation of the 
iterated algorithm in a 1-dimensional array J using the recursive scheme (10.4-3). THETIT 
is safeguarded against an exact or approximate vanishing of the denominator in eq. (10.4-3c) by 
using two variables HUGE and TINY. The elements s„ with n = 0, 1, 2, . . . of the sequence to be 
transformed have to be computed in a DO loop in the calling program. Whenever a new sequence 
element Sn is computed in the outer DO loop this subroutine THETIT has to be called again 
and a new string jj^" with < ^ < [[n/3| will be calculated. The new sequence element 
is read in via the variable SOFN and the approximation to the limit is returned via the variable 
ESTLIM. 

It is important to note that THETIT only calculates the approximations to the limit according 
to eqs. (10.4-4) - (10.4-6). The convergence of the whole acceleration or summation process has 
to be analyzed in the calling program. 
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SUBROUTINE THETIT ( SOFN , N , AR J , LARRAY , ESTLIM) 
DIMENSION ARJ(0: LARRAY) 

PARAMETER ( HUGE = l.E+60 , TINY = l.E-60 ) 
ARJ(N) = SOFN 
IF (N.LT.3) THEN 
ESTLIM = SOFN 
ELSE 

LMAX = N/3 
M = N 
DO 10 L = l.LMAX 
M = M - 3 
DIFFO = ARJ(M+1) - ARJ(M) 
DIFFl = ARJ(M+2) - ARJ(M+1) 
DIFF2 = ARJ(M+3) - ARJ(M+2) 

DENOM = DIFF2 * (DIFFl - DIFFO) - DIFFO * (DIFF2 - DIFFl) 
IF ( ABS (DENOM) .LT. TINY ) THEN 

ARJ(M) = HUGE 
ELSE 

ARJ(M) = ARJ(M+1) - DIFFO * DIFFl * (DIFF2 - DIFFl) / DENOM 
END IF 
CONTINUE 

ESTLIM = ARJ(M0D(N,3)) 
END IF 
RETURN 
END 
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11. On the derivation of theta-type algorithms 

11.1. New sequence transformations based upon Aitken's iterated process 

In section 10.1 it was discussed how Brczinski's ?? algorithm, eq. (10.1-9), can be derived 
by modifying Wynn's e algorithm, eq. (4.2-1). The i? algorithm is a very powerful sequence 
transformation. It accelerates linear convergence and sums divergent series approximately as 
efficiently as the e algorithm. However, unlike the e algorithm the "d algorithm is also able to 
accelerate many logarithmically convergent sequences. Consequently, it is frequently emphasized 
in the literature that Brezinski's •& algorithm combines the advantageous features of both Wynn's 
e and Wynn's p algorithm. 

Brezinski [27] suggested to use his approach, which led to the ?? algorithm, also in the case of 
other sequence transformations. This will be done in this section. However, one should not expect 
that Brezinski's approach will automatically lead to new sequence transformations that are more 
useful than the transformations from which they were derived. For instance, in the case of Wynn's 
p algorithm, eq. (6.2-2), which is formally almost identical with the e algorithm, Brezinski's 
approach led to the sequence transformation ©^"\ eq. (10.1-10), which is much less efficient than 
Wynn's p algorithm in the case of logarithmic convergence and which is also not very powerful in 

(n) 

the case of linear convergence or divergence. Consequently, the sequence transformation Qj^ is 
practically useless although it is certainly more versatile than the p algorithm from which it was 
derived. 

But even if Brezinski's i? concept does not automatically lead to practically useful new sequence 
transformations, it should nevertheless be worthwhile to investigate in which cases new sequence 
transformations can be obtained that are at least in some sense better than the transformations 
from which they were derived. 

It follows from eqs. (10.1-1) and (10.1-8) that the essential step in the derivation of the d 
algorithm consists in replacing a recursion of the general type 

/n = a„ + hn (11.1-1) 

by a more complicated modified recursion 

fn =^n-^hn. (11.1-2) 

Thus, a new sequence transformation can be constructed by replacing a recursion of the type 
of eq. (11.1-1) by a recursion of the type of eq. (11.1-2) in the recursive scheme which defines 
a given sequence transformation. The new sequence transformation will have a more nonlinear 
structure than the original transformation. In addition, such a modification will normally increase 
the order of the transformation by one. 

The probably closest relative of Wynn's e algorithm is Aitken's iterated process, eq. (5.1-15). 
This follows from the fact that because of eq. (5.1-5) the e algorithm may also be considered to be 
a generalization of Aitken's A^ process, eq. (5.1-4). Aitken's iterated A^ process and Wynn's e 
algorithm have similar properties since they are both able to accelerate linear convergence and to 
sum many divergent series but are unable to accelerate logarithmic convergence. Consequently, 
it would be interesting to see how Brezinski's ?? concept works in the case of Aitken's iterated A^ 
process. 

Let us now assume that a sequence transformation is defined by the following recursive scheme: 

Tq^") = s„ , n G INo , (ll.l-3a) 
Tkii = + D^k^ > fc, n G INo . (ll.l-3b) 
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(n) 

As in section 10.1 it is assumed that is a quantity which depends upon one or several 
elements of the table of this transformation. If this recursive scheme is to be modified along the 
lines of Brezinski's -d algorithm, a comparison with eqs. (11.1-1) and (11.1-2) shows that it must 
be changed in the following way: 

TfS"^ =s„, nGlNo, (ll.l-4a) 

Aitken's iterated process, eq. (5.1-15), is of the form of eq. (11.1-3). Thus, if Aitken's 
iterated process is modified according to eq. (11.1-4), a new sequence transformation B^^^ 
results which is defined by the following nonlinear recursive scheme: 

Sj") =Sn, nGlNo, (ll.l-5a) 

Again, it is assumed that the difference operator A acts only upon the superscript n and not 
upon the subscript k. 

However, this is not the only possibility of modifying Aitken's iterated A^ process. It follows 
from eq. (5.1-6) that the recursive scheme for Aitken's iterated A^ process can also be written in 
the following way: 

=s„, nGiNo, (ll.l-6a) 

This version of Aitken's iterated A^ process is a recursive scheme of the following type: 

TfS") = Sn , n G INo , (ll.l-7a) 
r(';\ = ri"+^) + , fe, n G INo . (ll.l-7b) 

If we compare this recursive scheme with eqs. (11.1-1) and (11.1-2) we see that it has to be 
modified in the following way: 

TfS") =Sn, nGlNo, (ll.l-8a) 
4% = Tt^'^ - , k,n eJNo. (ll.l-8b) 

However, a modification of the second version of Aitken's iterated A^ process, eq. (11.1-6), 
according to eq. (11.1-8) does not produce a new sequence transformation since we obtain the 
recursive scheme for the sequence transformation J^"'^ , eq. (10.3-6) , which was derived by iterating 

the expression for i?2"\ eq. (10.3-1). 

It follows from eq. (5.1-7) that there is another possibility of rewriting the recursive scheme for 
Aitken's A^ process in a way which would be suited for our purposes: 

A^o^ =Sn, nGlNo, (ll.l-9a) 
4? 1 = 4"^'^ - ^ 2 J , k,n^lN,. (ll.l-9b) 
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This version of Aitken's iterated process is a recursive scheme with the following general 
structure, 

T(|") = s„ , n G INo , (11.1-lOa) 
Ti% = r("+2) + dI^^ , k,nelNo, (11.1-lOb) 

which according to eqs. (11.1-1) and (11.1-2) has to be modified in the following way: 

T(S"^ =sn, neJNo, (11.1-lla) 

A ^(n+2) 

If the third version of Aitken's iterated process, cq. (11.1-9), is modified according to 

in] 

eq. (11.1-11), we obtain a new sequence transformation which is defined by the following 
nonlinear recursive scheme: 

Cj"^ = s„ , n G INo , (ll.l-12a) 

rA^(n+l)]2 r .^(n+2)-| \ \2n(n+l)l 

cSi = + rii2' Utft ^i%2^ M ' ^' - e ^0 . (ll.l-12b) 

^ [A4"+')]'[A2cf+')] - [a4"+')]'[A24")] 

The recursive schemes (11.1-5) and (11.1-12) for the two new sequence transformations B^^^ and 
C^""^ have the same structure as the recursive scheme (10.3-6) for since these transformations 
arc all weighted A^ methods. Consequently, the two new sequence transformations can be 

(n) 

computed in the same way as . In this context it is recommendable to rewrite the recursive 
scheme (11.1-5) in the following way: 

fij"^ =s„, n>0, (ll.l-13a) 

(n-3i)-|3 r A 2R("-3i+l)l 



7 7-1 r . ^('n-.3i1n2 r . o^fn-.Si-t-l-ln r . ^fr 



n > 3 , 1 < j < [ra/3]l . (ll.l-13b) 

As usual, \x\ denotes the integral part of x, i.e., the largest integer u satisfying u < x. The 
recursive scheme (11.1-12) should also be rewritten in the same way: 

Cj") =sn, n>0, (ll.l-14a) 

I \An-3j+l)-i2 r . ^(n-3i+2)-| r a 2/7(n-3i+l)l 

W ~ S -1 



J j-i [AC-"'^^-''''^'*]^ [A^C^""^-^"*""^-*] — [AC-"^^"''''^'*]^ [A^C^""^-'-'"! 

n > 3 , 1 < i < [n/31 . (ll.l-14b) 

It follows from eqs. (11.1-13) and (11.1-14) that after the input of a new sequence element Sm 

the strings B^T'^"^ and cj"'"^''^ with < ^i < lm/3j can be computed. 

The approximations to the limit of the sequence to be transformed depend upon the index m 
of the last sequence element Sm which was read in. Let xj^^^ stand for either B^^^ or C^."^ . Then, 
if m is a multiple of 3, m = 3/x, our approximation to the limit will be the transformation 

{S0,S1,...,S3^} ^ A"^"), (11.1-15) 
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if we have m = 3/x + 1, our approximation to the hmit will be 

{si,S2,...,S3^+i} ^ A-W, (11.1-16) 
and if we have m = 3fj, + 2, our approximation to the limit will be 

{S2, S3,..., 53^+2} ^ -^i'^ (11.1-17) 

These three relationships can be combined into a single equation yielding 

r -1 T^(m— 3[[m/3]|) , , q\ 

\^m-3[m/3]]) ■Sm-3|[m/3l+l) • • • ) ^mj- ^ [to/3] " l^ii.i-iOJ 

As in the case of the iterated '&2 algorithm J'^^\ eq. (10.3-6), the recursive computation of the 

strings s'f'^^^^ and cj"~^^'^ with < j < [n/3| can be done in 1-dimensional arrays B and C, 
respectively, if the elements of the tables of these sequence transformations are stored according 
to the following rule: 

'^i^m ^ 0^^^"- (11.1-19) 

Again, xj^""^ stands for either or and X stands for the corresponding 1-dimensional 
array B ov C. 

With this convention, the recursive scheme (11.1-13) can be reformulated in terms of the 
elements of the array B: 

B{n) ^Sn, n>0, (ll.l-20a) 

B(r.) ^ R(m) + [ABjmr [A' B{m + 1)] 

^ ^ ^ ' [AB(m)]2 [A2B(m + 1)] - [AB{m + 1)]2 [A'^B{m)] ' 
m = n-3j, n>3, l<j< In/3| . (ll.l-20b) 

Similarly, the recursive scheme (11.1-14) can be reformulated in terms of the elements of the 
array C: 

C{n) ^Sn, n>0, (ll.l-21a) 

rir.) ^ nr. ~2)^ [AC(m+l)]MAC(m + 2)] [A2C(m + 1)] 

^ ^ ^ ^ [AC(m + 1)]2 [A2C(m + 1)] - [AC{m + 2)]2 [A^C{m)] ' 
m = n-3j, n > 3 , 1 < j < fn/Sl . (ll.l-21b) 

It follows from their recursive schemes that J^l"'\ eq. (10.3-6), eq. (11.1-5), and eq. 

(11.1-12), are all transformations of order £ = 3k. In that respect, they are equivalent to , eq. 
(10.1-9), which needs the same set Sn, ■ ■ ■ ,Sn+3k of sequence elements for its computation. 
Numerical tests showed that the sequence transformations eq. (10.3-6), eq. (11.1- 

5), and eq. (11.1-12), are clearly more versatile than Aitken's iterated A2 process from 

which they were derived since they are also able to accelerate logarithmic convergence. The 

(n) 

sequence transformation B/, ' is in general less powerful than the other two transformations, and 

(n) 

is normally the most powerful transformation, being roughly comparable with Brezinski's 
algorithm. 
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11.2. New nonlinear sequence transformations obtained from linear transformations 

In this section we want to construct new sequence transformations by modifying the recursive 
schemes of the hnear transformations A^"''(/9, s„), eq. (7.3-20), J^j^'^\a, Sn), eq. (8.4-11), and 

^i"^(C,'Sn), eq. (9.4-11), according to eqs. (11.1-1) and (11.1-2). 

The recursive schemes (7.3-21), (8.4-12), and (9.4-12) for the hnear sequence transformations 

■'^n), ^]^\(^,Sn), and vj^^Csn) are ah of the form of eq. (11.1-7). Consequently, these 
recursive schemes wih be modified according to eq. (11.1-8). Hence, in the case of the recursive 

scheme (7.3-21) for the sequence transformation a[,"''(/3, s„) we obtain a new nonhnear sequence 

(n) 

transformation which is defined by the fohowing recursive scheme: 

aE,") =sn, nelNo, (11.2-la) 

(n) (n+1) W + n) lAxt"^] [AaI^+'^I 

4+1 = 4 \ J, ^ ^ ' k,nelNo. 11.2-lb 

' i/3 + n + 1) [Aa1"+^)] -iP + n) [AX^^] 

As usual, it is assumed here that the difference operator A acts only upon the superscript n 
and not upon the subscript k. 

(n) 

The nonlinear sequence transformation cr^ ^ is obtained by modifying the recursive scheme 

<n). 



(8.4-12) for .;^f^(a,s„) : 



(n) 



neJNo, (11.2-2a) 



(n) (n+1) (a + n + k) lAai"^] [A^^+'^l 

= ' ^ ^, ^ ^ ^ ^ ^ ^ , fc, n G Mo . 11.2-2b 

Finally, a modification of the recursive scheme (9.4-12) for V^\c,Sn) yields the nonlinear 
sequence transformation /Lt^"^ : 

=Sn, nelNo, (11.2-3a) 
(C + n-fe) [a4")] [A^r^^l 



,(n) _ „(n+l) _ 

{( + n-k + l) [A/.i"+^T _ (C + n - fc) [A^^l 



= ^^^^ 1^ ; L^,, ^ ' L "'^ ^ , it, n G INo . (11.2-3b) 



These new sequence transformations A^"'^ "^i^^ ^'^d arc all weighted A^ methods, i.e., mod- 
ifications of Aitken's iterated A^ process, eq. (5.1-15). In this context it may be of interest that 
Aitken's iterated A^ process can also be derived by modifying a linear sequence transformation 
along the lines of Brezinski's -& algorithm. Let us consider the following recursive scheme: 

r(n) 



X^"^ =sn, nelNo, (11.2-4a) 

An) . 



4+\ =4"^ + ' fc, n G ]No . (11.2-4b) 



in) 

Obviously, the sequence transformation Tj^ , which is defined by a recursive scheme of the type 
of eq. (11.1-3), can also be written in the following way: 

X^") = E'^sn. (11.2-5) 
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Here, E denotes the shift operator which is defined by eq. (2.2-4). If the recursive scheme 
(11.2-4) is changed according to eq. (11.1-4), we obtain Aitken's iterated process, eq. (5.1- 
15). 

The similarity of X^^\ o-^\ and /Lt^"'* with Aitken's iterated process implies that these 
sequence transformations can be computed in the same way as Aitken's iterated A^ process. For 
that purpose, it is recommendable to rewrite the recursive scheme (11.2-1) for A^"^ in the following 
way: 

X^Q^ =Sn, n>0, (11.2-6a) 
,M)^,(n-2.+i) (/? + n-2,)[AA(."_f^-)] [AAf_f^-+^)] 

W + n-2j + 1) [AAf_f ^■+^)] -iP + n- 2j) [AXf_\'^^] ' 
n>2, l<J<[[n/2]l. (11.2-6b) 

The recursive schemes (11.2-2) and (11.2-3) should also be rewritten in the same way: 

(jj"^ =Sn, n>0, (11.2-7a) 

(g + n-,) [A.j-^^-)] [A.j-^^-^^)] 
'- + n-j + 1) [Aa]"_7^^+^)] -{a + n-j) [Aaf.T^^^l ' 



(a 



n>2, l<j<ttn/2|. (11.2- 7b) 

Ato"^ =Sn, n>0, (11.2-8a) 

(n-2,)_ (C + n - 3,) [A^j^^^')] [A^f_f^-+^^] 



(C + n - 3j + 1) [AM5"_f ^■+^)] - (C + n - 3j) [A^^S,'^^] ' 
n>2, l<j<|In/2|. (11.2-8b) 

As in the case of Aitken's iterated A^ process, the approximations to the limit of these 
transformations depend upon the index m of the last sequence element which was used in these 
recursions. Let X^"-^ now stand for any of the sequence transformations A^"\ •^i"'*) or Then, 
if m is even, m = 2/x, our approximations to the limit of the sequence are the transformations 

{so,su...,S2^,} ^ (11.2-9) 

and if m is odd, m = 2/x -|- 1, our approximations to the limit will be 

{si,S2,...,S2M+l} ^ ^/i''- (11.2-10) 

These two relationships can be combined into a single equation yielding 

r 1 -i^(m— 2|[m/2]]) /-■ -, r, 

l«m-2[m/2l5Sm-2lm/21+l5 • • • ,Smj- ^ ' [Li.Z-ii.) 

Only 1-dimensional arrays A, a, and jl will be needed for the computation of the sequence 
transformations A^"'', cr^\ and /x^"^ if the elements of the tables of these transformations are 
stored in the same way as the elements of the Aitken table according to eq. (5.2-6), i.e., 

"^i^m ^ ^^0, 0<i^<n. (11.2-12) 
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Here, xj^""^ stands for any of the three sequence transformations A^"\ '^k^\ l^^k^ ■> ^'^'^ 
X stands for the corresponding 1-dimensional array, i.e., either for A, a, or for ji. With this 
convention, the recursive scheme (11.2-6) for a[."^ can be reformulated in terms of the elements of 
the 1-dimensional array A: 

A(n) =Sn , n > 0, (11.2-13a) 

= A(™ + 1) (/? + m)[AA(„.)][AA(,„+l)] _ 

(/? + m + 1) [AA(m + 1)J - (/3 + 

m = n-2j, n > 2 , 1 < j < [[n/2j . (11.2-13b) 

With the help of convention (11.2-12) the recursive schemes (11.2-7) for (t["^ and (11.2-8) for 

(n) 

can also be reformulated in terms of the elements of the arrays a and jl yielding similar 



expressions. 

It follows from their recursive schemes that A^""*, eq. (11.2-1), cr^^\ eq. (11.2-2), and eq. 

(11.2-3), are all transformations of order I = 2k. In that respect, they are equivalent to A^^\ 

eq. (5.1-15), and , eq. (4.2-1), which need the same set s„, . . . , Sn+2k of sequence elements for 
their computation. 

We shall see later that the nonlinear sequence transformations a["\ t^k^^ more 

versatile than the linear sequence transformations A^."-* (/?, s„), eq. (7.3-20), T^^\a,Sn), eq. (8.4- 

11), and v]^\C,,Sn), eq. (9.4-12), from which they were derived, since they are not only able to 
accelerate logarithmic convergence but also linear convergence. In addition, they can also sum 
many divergent series. Numerical tests showed that \^^\ eq. (11.2-1), is normally a more powerful 
sequence transformation than (7^"\ eq. (11.2-2), or eq. (11.2-3). 
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12. A theoretical analysis of sequence transformations 

12.1. Germain-Bonne's formal theory of convergence acceleration 

The properties of linear and nonlinear sequence transformations are in some sense complemen- 
tary. Theoretically, linear sequence transformations arc now very well understood (see for instance 
refs. [4] and [7-11]) but their power as well as their practical usefulness is very limited. Nonlin- 
ear sequence transformations are often able to achieve spectacular results, but theoretically, only 
relatively little is known. 

Any theory of nonlinear sequence transformations has to say something about the two fun- 
damental questions which arise in connection with acceleration of convergence. Firstly, is the 
transformation under consideration regular, i.e., will the transformed sequence {[s^]} converge to 
the same limit as the original sequence {[sn]}. Secondly, will the transformed sequence converge 
more rapidly than the original sequence. 

The first attempt to develop a general theory of the regularity and the acceleration properties 
of nonlinear sequence transformations is due to Germain-Bonne [33] who considered sequence 
transformations G/. with k G INq that arc functions defined on vectors x = {xi,X2, ■ ■ ■ ,Xk^i), 
i.e., functions of the type Gk ■ IR^+^ IR. Germain-Bonne postulated that these sequence 
transformations G^ possess some very general properties such as continuity, homogeneity and 
translativity. On the basis of these postulates Germain-Bonne could formulate some conditions 
which guarantee the regularity of such a sequence transformation. In addition, Germain-Bonne 
succeeded in formulating a general criterion which decides whether a sequence transformation G^ 
accelerates linear convergence or not. A good treatment of Germain-Bonne's formal theory of 
convergence acceleration [33] can also be found in Wimp's book (see pp. 101 - 105 of ref. [23]). 

The applicability of Germain-Bonne's theory in its original version is quite limited. The reason 
is that Germain-Bonne treats sequence transformations which depend upon n only implicitly via 
the k + 1 sequence elements s^, s„+i, . . . , s„+fe, on which they act, but not explicitly. Conse- 
quently, Germain-Bonne's theory is limited to sequence transformations as for instance Wynn's 
e algorithm, eq. (4.2-1), Aitken's iterated process, eq. (5.1-15), or Brezinski's "i? algorithm, 
eq. (10.1-9), which are all defined by recursive schemes that do not depend explicitly upon n. It 

cannot be applied in the case of a sequence transformation such as A^"\ eq. (11.2-1), although 
it is a close relative of Aitken's iterated process, since its recursive scheme depends explicitly 
on n. Consequently, in this section Germain-Bonne's theory will be modified in such a way that 
it can be applied to the sequence transformations of this report which mostly depend explicitly 
upon n. 

(n) 

Let us therefore assume that for fixed k G IMq a sequence transformation is a function 
which is defined on vectors x = {xi,X2, . . . ,a^fe+i) € IR*^"*"^ and which may depend explicitly on 
n G INq. In addition, we assume that such a sequence transformation G^"'' : IR*^+^ — > IR possesses 
for fixed k G INq and for all n G INq the following properties: 

(H-0): G^"^-* is defined and continuous on a subset X^") of JR'^+^. 

(H-1 ): G^^'^ is a homogeneous function of degree one. This means that G^^ satisfies for arbitrary vectors 
X G X(") and for all X E M such that Ax is still an element of X^") 



(H-2): Gj^ is invariant under translation in the sense of eq. (3.1-4). Consequently, for arbitrary t E IR 



Gl''{Xxi,Xx2,...,Xxk+i) = XG^^'{xi,X2 



■ ■,Xk+l) ■ 



(12.1-1) 




..,Xk+l) + t. 



(12.1-2) 
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(H-3): A subset X(°°) of JR'^^"^ exists such that for every vector x = {xi,X2, • • • , a^fc+i) belonging to this 
subset the Umiting transformation 

G^j^\xi,X2,...,Xk+i) = J-irn^ G^"^(xi,X2,...,Xfc+i) (12.1-3) 

is uniquely defined and continuous. In addition, it is assumed that the limiting transformation 
is also homogeneous and invariant under translation according to (H-1) and (H-2). 

The first three postulates (H-0) - (H-2) are essentially identical with the analogous postulates 
made by Germain-Bonne [33]. The main difference is that here a sequence transformation G^^^ 
may depend explicitly upon n and not only implicitly via the A: + 1 sequence elements Sn, Sn+i, 
. . ., Sn+k on which it acts. Some of Germain-Bonne's results are based on the limiting behaviour 
of a sequence transformation Gfe(s„, . . . , Sn+fe) as n ^ oo. If we want to formulate analogous 

(n) 

results for a sequence transformation Gj^ , which may depend explicitly on n, we have to require 

(n) 

that the limit n — >■ oo can be performed in the expression defining and that a unique limiting 

transformation G^°°^ exists which is defined and continuous on a suitable subset X(~) of IR'^+i 
and which is also homogeneous and translative according to (H-1) and (H-2). 

Conditions for the existence of the limiting transformation g[,°°'' were discussed by Smith and 
Ford (see p. 226 of ref. [29]). Their analysis was based upon that version of the Moore - Smith 
theorem [93] which can be found in Gleason's book (see p. 256 of ref. [94]). However, for our 
purposes it is probably simpler to postulate the validity of (H-3), since in all cases, in which we 
shall have to do such a limit n — > oo, the existence of a limiting transformation G^°°'* with the 
required properties will always be quite obvious. 

In (H-1) the restriction, that Ax has to be an element of X^"-*, is necessary. The reason is that 
nonlinear sequence transformations are frequently not defined for constant sequences. In such a 
case, A = has to be excluded because G^"^ would not be defined for the vector x = (0, 0, . . . , 0). 

Concerning (H-3) it should be noted that G^"^ with n being finite and its limiting transformation 
Gj,°°^ are not necessarily defined and continuous on the same subset of mf'+K i.e., in general 

X(") ^ X(°°'. For instance, if in the recursive scheme (11.2-1) for A^"^ the limit n — > oo is 
performed according to eq. (12.1-3), wc obtain the second version of Aitken's iterated process, 
eq. (11.1-6). If we compare the subsets of IR^, for which the explicit expressions for and 
A^"^ are continuous, wc find that Aitken's process is defined for vectors x = (xi,X2,X3) which 

(n) 

satisfy xi — 2x2 + x^ ^ 0. A different restriction is necessary in the case of A^ as long as n is 
finite. 

(n) 

It was remarked above that a given sequence transformation G^. will normally not be con- 
tinuous for arbitrary vectors x G IR^"^^. If, however, a sequence transformation G^"^ is defined 
and continuous for all vectors x G IR'^"'"^, then the regularity of this transformation can be proved 
quite easily. 

Theorem 12-1: If a sequence transformation G^^*"^ is a continuous function on IR^~^^ for all n G Wq and 
if its limiting transformation G^°°^ is also continuous on M^'^^ and satisfies (H-l) and (II-2), then 
G^^ is regular, i.e., it preserves the limit s of every convergent sequence {[sn]}- 

Proof: Since G^"^ is continuous on IR^"*"^ for all n G INq and since {[s^]} converges to some limit 
s, we have by continuity 

lim G^,^\sn,Sn+i,...,Sn+k) = g[.°°^ (s, s, . . . , s) . (12.1-4) 
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Since (H-2) remains valid as n ^ oo, we may conclude that for all constant sequences s,s,s, . . . 
we have 

Gi°^\s,s,...,s) = s + G^^\0A ■ ■ ■ ,0) . (12.1-5) 
In the same way, (H-1) remains valid as n — > oo. Thus, we may conclude 

4°°^(0,0,...,0) = 0. (12.1-6) 

Hence, it follows from eqs. (12.1-4) - (12.1-6) that a sequence transformation G^^\ which 
satisfies the above assumptions, is regular. 

Unfortunately, theorem 12-1 will be of little use in the case of nonlinear sequence transforma- 
tions which are in general nonregular. A nonlinear sequence transformation G^^^ is normally a ra- 
tional function of the k+1 sequence elements s„, Sn+i, ■■■ , Sn+k which are used for its computation. 
Since rational functions have poles, wc cannot expect that nonlinear sequence transformations will 
be continuous on IR'^^^. Consequently, in the case of a nonlinear sequence transformation the 
convergence of an arbitrary sequence {[sn]} to some limit s does not imply that the transformed 
sequence converges at all, let alone to the same limit. In addition, eqs. (12.1-5) and (12.1-6) need 
not be valid since nonlinear sequence transformations are not necessarily defined for constant 
sequences. 

Theorem 12-2: Let E)^^^ be the set of vectors x G IR^^^ with distinct components. Every sequence 
transformation G^\ which is a continuous function for all vectors x G V^'^^ and which also satisfies 
(H-1 ) and (H-2), can be expressed in the following way: 

Gl '{xi,X2,...,Xk+i) = xi + {x2-xi)gl . (12.1-7) 

\X2-Xl Xk-Xk-lJ 

The associated transformation qI"'* which is defined and continuous on a subset of JF*~^, the set of 



9 k 

vectors y G JR ^ with nonzero components, is given by 



M(xs-X2^_ ^^Xk^^-Xk\ ^ ^^^0,1,1 + ^^,...,^ ff^i±i^^V (12.1-8) 

\X2-Xi Xk-Xk-lJ \ X2-XI f^f^ fj^ Xi+2 - Xi+i J 

Proof: According to (H-2) we can subtract x\ from G^"\ and according to (H-1) we can divide 
the k + 1 arguments of G^"^ by X2 — Xi. This yields: 

G(")(xi,X2,...,x,+i) = XI + (x2-xi)4")fo,l,^^^,...,^^±i^y (12.1-9) 

\ X2 - Xl X2 — Xl J 

We now need the following relationship which can be proved quite easily: 

x^^^^-x, ^ ^ x,+s - X,+2 ^ (^2.1-10) 

X2-XI ^ f^^^ Xi+2 - Xi+i 

If we insert eq. (12.1-10) into eq. (12.1-9) we obtain eqs. (12.1-7) and (12.1-8). The continuity 

of g^jf' on the subset of vectors y = {yi,y2, • • • ,2/fc-i) G F^~"^, which are generated from vectors 
X = {xi,X2, . . . , Xk+i) G ID^"*"^ via the relationship 

Vfi = {xn+2 - a;^+i) / {x^+i -x^), 1 < < k -1, (12.1-11) 
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follows via eq. (12.1-7) from the continuity of Gj^ on ID*^^^. However, an associated transfor- 
mation y^"^ in the sense of eqs. (12.1-7) and (12.1-8) is not defined for all vectors y G F*^"^. For 
instance, if we choose y = (1,— 1,1,— 1,...), which clearly belongs to F'^"^, we are not able to 
find a vector x = {xi,X2, ■ ■ ■ ,Xk+i) £ ID^'^^ which satisfies eq. (12.1-11). 

With the help of theorem 12-2 it can be analyzed for which convergent sequences {[s„]} a 
sequence transformation G^^^ satisfying (H-0) - (H-3) will be regular. 

Theorem 12-3: Let G^"^ be a sequence transformation which satisfies theorem 12-2. This means that 

(n) 

according to eqs. (12.1-7) and (12.1-8) an associated transformation exists which is defined and 
continuous on that subset of vectors y = (yi, y2, . . . , Uk-l) £ iF*~^ which is generated by all vectors 
X = (xi, X2, . . . , a^fc+l) G D^~^^ according to eq. (12.1-11). If the limiting associated transformation, 
which is defined by 

3k'\yi,y2, ■ ■ ■ ,yk-i) = Jim^5lr\yi>y2,---,yfe-i), (12.1-12) 

is also defined and continuous on the same subset of JF*~^ as then G^^ will preserve the limit 

s of every convergent sequence {[s^i]} having the following properties: 

(i) : For sufficiently large values of n ^ Wq the sequence elements Sn are all distinct. 

(a): For sufEciently large values ofnE Wq the ratios As^+i/As^ all satisfy the inequality 

c < |As„+i/As„| <c', 0<c<c'<oo. (12.1-13) 



Proof: It follows from (i) that As„ 7^ for sufficiently large values of n. Consequently, G^^' can 
be rewritten for sufficiently large values of n according to eq. (12.1-7) yielding 

(Sn,Sn+l,---,Sn+fe) = + As„ 5^ ' — , • • • , • (12.1-14) 

V LlSn-\-k-2/ 

According to eq. (12.1-8) the associated transformation is given by 

'^^^■■■■■^) -^'("'^■^-^■■■■|n^). ™ 

Gj."^ will preserve the limit of if the second term on the right-hand side of eq. (12.1-14) 

vanishes as n ^ cxd. Since {[sn]} converges, As„ vanishes as n ^ cxd and wc only have to show 

(n) 

that the associated transformation gj^ remains bounded as n ^ cxd. The limiting associated 
transformation 5'^°^'* is by assumption defined and continuous on that subset of F'^^^ which is 
generated from vectors x G E)'^'^^ according to eq. (12.1-11). Continuity of a given function on 
a certain subset implies the boundedness of this function for all bounded elements belonging to 
this subset. It follows from (i) that for sufficiently large values of n every string s„, Sn+ij ■ ■ ■ , Sn+fc 
belongs to ID'^"''^, and it follows from (ii) that for sufficiently large values of n the k — 1 arguments 

of g^^ in eq. (12.1-15) are all nonzero and bounded. This implies that g^^ will remain bounded 
as n ^ 00. This concludes the proof of theorem 12-3. 

(n) 

Next, a criterion will be formulated which decides whether a sequence transformation G^, , 
which may depend explicitly upon n, is able to accelerate linear convergence or not. This 
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is probably the most important result of our adaptation of Germain-Bonne's formal theory of 
convergence acceleration [33]. 

Theorem 12-4: Let us assume that a sequence {[sn]} converges linearly to some limit s, i.e., 

lim ~ ^ = p, < Ipl < 1. (12.1-16) 

n— »oo S„ — S 

Then, a necessary and sufRcient condition that a .sequence transformation G^"^ : JR*^+^ IR 
accelerates the convergence of {[s„]} is that its associated transformation satisfies: 

lim g''^\pn,pn+i,- ■ ■ ,Pn+k-2) = g'f\p,p,...,p) = . (12.1-17) 

n— >oo 1 ~ P 

Here, {[pn]} is an arbitrary sequence which converges to p. The above statement can also be formulated 



in terms of the limiting transformation G^^^ : 



/ k-l j-1 . 

lim 0,l,l + p„,...,^ n 

Pn+i 

^ j=0 i=0 ^ 

= Gf)(o,l,l + p,...,^p') = 0<|p|<l. (12.1-18) 

Proof: Since {[s„]} converges linearly, it follows from cqs. (2.6-3) and (2.6-4) that As^j ~ p" as 
n — >■ cxD. Thus, g["^ can for sufficiently large values of n be rewritten according to eq. (12.1-14). 
If we subtract s from both sides of eq. (12.1-14) and divide the resulting expression by s„ — s we 
obtain: 

G^^\sn, Sn+l, . . . , gn+fc) - S _ ASn (n) / ^Sn+l /,„ , ^^.s 

Sn- S S„ - S " V ASn ASn+k-2 J 

According to eq. (2.6-6) the convergence of a sequence {[sn]}- to its limit s is accelerated by a 
sequence transformation G^^^ if 



lim ^ ^ q_ (12.1-20) 



n— >oo 



Hence , if wc perform the limit n — > cxo in eq. (12.1-19), the left-hand side has to vanish if 
accelerates convergence. Thus, we only have to investigate under which conditions the right-hand 
side of eq. (12.1-19) also vanishes as n — > oo. With the help of eq. (12.1-16) we find: 

lim = lim £!^±i^ _ 1 = p _ 1 . (12.1-21) 

n^oo Sn — S n-*oo Sn — S 

Next, we observe that because of the equivalence of eqs. (2.6-3) and (2.6-4) for sequences 
satisfying eq. (12.1-16) the arguments 

Pn = Asn+i/Asn, n G INq , (12.1-22) 
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of the associated transformation in eq. (12.1-19) converge to p as n — > oo. Now, the right- 
hand side of eq. (12.1-19) can only vanish as n — oo if the hmiting associated transformation 
5^°°'' satisfies eq. (12.1-17). In the same way, if eq. (12.1-17) is satisfied, then because of eq. 
(12.1-21) the right-hand side of eq. (12.1-19) vanishes. Consequently, the validity of eq. (12.1-17) 

(n) 

is equivalent to the statement that accelerates linear convergence. 

The sequence 0, 1, 1 -|- p, . . ., on which the limiting transformation acts in eq. (12.1-18), 

is apart from its first element and apart from a shift of the indices identical with the sequence of 
partial sums of the geometric series, eq. (2.6-2). This is best seen by rewriting the elements of 
this sequence in the following way: 

(Tn{p) = = y,P"^ < IpI < 1 , n G INo . (12.1-23) 

Obviously, this shifted sequence also converges to 1/(1 — p) as n — > oo. Hence, we see that 

in) 

theorem 12-4, which decides whether a given sequence transformation G\ accelerates linear 

convergence or not, requires that the limiting transformation is exact for the shifted sequence 
•{[(T„(p)]} of partial sums of the geometric series. This fact indicates that there is a close connection 
between the exactness of a sequence transformation for the partial sums of the geometric series 
and its ability of accelerating linear convergence. 



12.2. Applications of Germain-Bonne's theory 

In this section, the properties of certain sequence transformations will be analyzed with the help 
of Germain-Bonne's formal theory of convergence acceleration. The most interesting feature of 
Germain-Bonne's theory is its treatment of the acceleration of linear convergence. Consequently, 
theorem 12-4 and related questions such as the exactness of a sequence transformation for the 
geometric series will be emphasized in this section. 

First, we want to investigate the sequence transformations A^""*, eq. (11.2-1), cr^^\ eq. (11.2- 

2), and p["\ cq. (11.2-3), which are close relatives of Aitken's iterated process, eq. (5.1-15). 
However, it follows from their recursive schemes (11.2-1) - (11.2-3) that unlike Aitken's process 

Ai''\ eq. (5.1-4), which is by construction exact for the geometric series, A^"'*, (T^"\ and ji'^'' are 

not exact for the geometric series. Consequently, it is not obvious whether A^"\ (t("\ and p^"\ 
accelerate linear convergence. 

Theorem 12-5: The sequence transformations A^"-*, eq. (11.2-1), (7^^\ eq. (11.2-2), and ix'l^\ eq. 
(11.2-3), accelerate linear convergence if and only if Aitken's iterated A process 

eq. (5.1-15), 

accelerates linear convergence. 

Proof: According to theorem 12-4 a sequence transformation G^"^ accelerates linear convergence 
if it possesses a limiting transformation which satisfies eq. (12.1-18). If we perform the 

limit n — > oo in the recursive scheme (11.2-1) for A^"^ according to eq. (12.1-3), we find that the 

(n) 

limiting transformation of A^ is defined by a recursive scheme which is identical with the second 
version of Aitken's iterated A^ process, eq. (11.1-6). 

Hence, it follows from eq. (12.1-18) that A^"^ accelerates linear convergence if the elements 
of the sequence -{[(T„(p)]}, eq. (12.1-23) are transformed into 1/(1 — p) by the recursive scheme 
(11.1-6). 



96 



However, since Aitken's iterated process does not depend explicitly upon n, this is at 
the same time the condition which determines whether Aitken's iterated process is able to 
accelerate linear convergence. 

If we perform the limit n — > cx3 in the recursive schemes (11.2-2) for and (11.2-3) for /Lt^"'* in 
the sense of eq. (12.1-3), we find that they have the same limiting transformation which is again 
defined by the recursive scheme for Aitken's iterated A^ process, eq. (11.1-6). This concludes the 
proof of theorem 12-5. 

Aitken's iterated A^ process is defined by a recursive scheme and no explicit expression is known. 
Consequently, a general proof, that ^^"^ accelerates linear convergence for all A; > 1, does not 

seem possible. Instead, one can only construct an explicit rational expression for some special ^^"^ 
with k,n being fixed integers. It can then be checked whether this explicit expression produces 
1/(1 — p) if it is applied to the elements of the sequence {[o"rt(/5)]}, eq. (12.1-23). Unfortunately, 
these rational expressions become very complicated for larger values of the subscript k. Therefore, 
it is rccommcndable to consider only the simplest case. 

Theorem 12-6: Aitken's A^ process Ai^\ eq. (5.1-4), accelerates linear convergence for all n G Wq. 

Proof: According to theorem 12-4 we have to show that Aitken's A^ process Af\ eq. (5.1-4), 
produces 1/(1 — p) if it acts upon the sequence elements cro(p), cri(p), and a2{p) which are defined 
by eq. (12.1-23). Straightforward computation shows: 

4°^ = Mp) - , = • (12.2-1) 

^ ^ ^ (T2{p) - ^aiip) + ao{p) 1-p ^ ^ 



It follows from theorems 12-5 and 12-6 that , a\ , and p\ also accelerate linear convergence 
for all n G INq. 

Here, it must be emphasized that theorem 12-6 does not imply that ^["^ with k > 1 will also 
accelerate linear convergence. This has to be checked separately and independently for every 

(n) 

k > 1. For instance, it follows from eq. (5.1-5) and theorem 12-6 that €2 also accelerates linear 

(n) 

convergence. However, in Wimp's book it is shown that in the case €4 ' the limited associated 
transformation according to eqs. (12.1-7) and (12.1-8) cannot satisfy eq. (12.1-17) since it is 
unbounded in the vicinity of any {p,p,p) G IR^ (see pp. 127 - 128 of ref. [23]). 

Next, the sequence transformations J'l^^\ eq. (10.3-6), b'^\ eq. (11.1-5), and eq. (11.1- 
12), will be analyzed. Again, no explicit expressions are known for these transformations which 
are all defined by recursive schemes. Hence, as in the case of Aitken's iterated A^ process, eq. 
(5.1-15), only special cases can be considered and it is again recommendable to consider only the 
simplest case. 

A simple calculation shows that Ji^\ B^^^\ and cj^"^ are exact for the partial sums (2.6-2) of the 
geometric series. Consequently, it is not surprising that these transformations accelerate linear 
convergence. 

Theorem 12-7: The sequence transformations \ eq. (10.3-6), \ eq. (11.1-5), and \ eq. 

(11.1-12), accelerate linear convergence for all n G Wo. 

Proof: The recursive schemes, which define these sequence transformations, do not depend 
explicitly on n. Consequently, one only has to show that the explicit expressions 

and B^i^ produce 1/(1 — p) if they are applied to the first four elements of the sequence {[a"„(p)]}, 
eq. (12.1-23). Straightforward computation shows that this and consequently theorem 12-7 is 
indeed true. 
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Since J'^"'^ is identical with theorem 12-7 also implies that 1^2" accelerates linear conver- 
gence. 

Next, we shall analyze those variants of the sequence transformations J0^^\p, Sn,a;„), eq. (7.1- 

7), S!^\p,sn,ujn), eq. (8.2-7), {j, Sn,uJn), eq. (9.2-6), and vP{sn,uJn), cq. (9.5-4), which 

are based upon Levin's [28] explicit remainder estimates (7.3-4), (7.3-6), and (7.3-10), as well 
as Smith and Ford's [29] modified remainder estimate (7.3-8). First, it will be shown that these 
sequence transformations are exact for the geometric scries. For that purpose it is rccommcndable 
to modify a theorem, which was originally used by Smith and Ford (see p. 227 of rcf. [29]) to 

prove that u^j^\p,Sn), eq. (7.3-5), d^j^^\p , Sn) , eq. (7.3-9), and v^^\/3,Sn), eq. (7.3-11), are exact 
for the geometric series, in such a way that it can also be applied in the case of the analogous 

variants of 5j^'*^(/3, s„, Wn), M^j^^j, and V'^\ 

Theorem 12-8: Assume that a sequence transformation T^\sn,0Jn) is defined in tiie following way: 



rr(^n,a;n) = ,r,„^^Z:7 KneMo. (12.2-2) 



Here, Pfe_i(n) is a polynomial of degree < k — 1 in n. The sequence transformation is defined 
if the elements of {[sn]} are bounded in magnitude and if the sequence {[wn]} of remainder estimates 
is chosen in such a way that the denominator in eq. (12.2-2) does not vanish. 

Let us assume that the sequence {[s^]}- converges to some limit s. Then, for k > 1 and for n > 
this sequence transformation T^"^ (s„, a;„) is exact for the sequence {[sn]} if the sequence ^ujn^ of 
remainder estimate can be chosen in such a way that the denominator in eq. (12.2-2) does not vanish 
and that Un is proportional to Sn — s, i.e., 

Un = c{sn-s), c 7^ , U E INq . (12.2-3) 

Proof: Since this sequence transformation Tj^"'*(s„, a;„) is obviously invariant under translation 
in the sense of eq. (3.1-4), we can write 



.(n)^„ ,, ^ _ „ , [Pk-i{n) (sn - s)/ u 

AMPjt_i(n)/a;„] 



TP (sn, iOn) = s + ^Ir ^ /. '. i ' A:, n G Mq . (12.2-4) 



If LOn is proportional to s„ — s according to eq. (12.2-3), the difference operator A'^ in the 

numerator on the right-hand side acts only on Pk-i{n) which is a annihilated because it is a 
polynomial of degree < k — 1 in n. Since the denominator on the right-hand side of eq. (12.2-4) 
docs not vanish by assumption, wc sec that T^"'' is exact for {[sn]}'- 

It is immediately obvious that the sequence transformations C^j^\p, Sn,(jJn), eq. (7.1-7), 

Sj^\l3,sn,u;n), eq. (8.2-7), M^j^Hj, Sn,0Jn), eq. (9.2-6), and pj^"^(s„,a;„), eq. (9.5-4), are ah 
of the form of eq. (12.2-2). Hence, according to theorem 12-8 these sequence transformations are 
exact for the partial sums (2.6-2) of the geometric series if the remainder estimates a;„ satisfy 

Un = c- — -, CT^O, nGlNo. (12.2-5) 

Since /(I — z) is for fixed z and a also a constant, an equivalent condition for the exactness 
would be: 

UJn = c'z"-°^+S cVO, nGiNo, aGlR. (12.2-6) 
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Theorem 12-9: The sequence transformations ujf^ {f3,Sn), eq. (7.3-5), y'^^\f5,Sn), eq. (8.4-2), and 
Y^^^jjSn), eq. (9.4-2), are all exact for the geometric series for k > 2 and n > Q, whereas 
tt'\P,Sn), eq. (7.3-7), df\f3,Sn), eq. (7.3-9), 4"^(/?,Sn), eq. (7.3-11), T^''\p,Sn), eq. (8.4-3), 
S^^\p,Sn), eq. (8.4-4), ipP{P,Sn), eq. (8.4-5), T^^\-i, Sn), eq. (9.4-3), Sn), eq. (9.4-4), 

and ^^f^^ (7, Sn), Gq. (9.4-5), are all exact for the geometric series for k > 1 and n > 0. Drummond^s 
sequence transformation X^^ ^(s^^, 

ujn), cq. (9.5-4), is also exact fork>l and n>0 if the remainder 
estimates (7.3-6), (7.3-8), and (7.3-10) are used. 

Proof: We only have to prove that in the case of the partial sums (2.6-2) of the geometric series the 

remainder estimates, which define these variants of the sequence transformations >C^"'''(/3, s„, cj^), 

eq. (7.1-7),4"^(/?,s„,a;„),eq. (8.2-7), M^^\^, Sn,u;n), eq. (9.2-6), and a;„), eq. (9.5-4), 

lead to sequence transformations of the type of eq. (12.2-2) with remainder estimates Un that 
satisfy either eq. (12.2-5) or (12.2-6). 

The remainder estimate (7.3-4) leads to Un = (P + n)z"'. In the case of u^^\(3, Sn), eq. (7.3- 

5), and y^\j3,Sn), eq. (8.4-2), the factor (3 -\- n can be absorbed in eqs. (7.1-6) and (8.2-6), 
respectively, leading for > 2 to new sequence transformations which are of the type of eq. (12.2- 
2). This proves the exactness of u^j^^ (/?, s„) and (/?, s„). The exactness of Y^"^^ (7, s„), eq. (9.4- 
2), can be proved in the same way because the remainder estimate (9.4-1) yields Un = —(7-1-71)2;"' 
and because — 7— n can for k > 2he absorbed in eq. (9.2-5) yielding a new sequence transformation 

satisfying eq. (12.2-2). However, in the case of Drummond's sequence transformation T>^^ (s„, LOn), 
eq. (9.5-4), we would not obtain a sequence transformation of the type of eq. (12.2-2) if we absorb 
either /? -|- n or —7 — n. Thus, with neither of the two remainder estimates (7.3-4) or (9.4-1) 
Drummond's sequence transformation is exact for the geometric series. 

The remainder estimate (7.3-6) leads to ujn = Because of cq. (12.2-6) this proves the 
exactness of t^^\p,Sn), eq. (7.3-7), r^"''(/3, s„), eq. (8.4-3), and r^"''(7,s„), eq. (9.4-3), for k > 1. 

With this remainder estimate 'D^\sn,u}n) is also exact for A; > 1. 

The remainder estimate (7.3-8) leads to Un = z^'^^. Because of eq. (12.2-6) this proves the 
exactness of 4"^(/3, s„), eq. (7.3-9), 4"^(^,s„), eq. (8.4-4), and A^^\-i,Sn), eq. (9.4-4), for A; > 1. 

With this remainder estimate P[,"'^(s„, Wn) is also exact for A; > 1. 

The remainder estimate (7.3-10) leads to uJn = z"^^^ /(I — z). Because of eq. (12.2-5) this proves 
the exactness of 4"^(/9, s„), eq. (7.3-11), (ff\l3,Sn), eq. (8.4-5), and $^"'^(7, s„), eq. (9.4-5), for 
k>l. With this remainder estimate V^^\sn,'jJn) is also exact for A: > 1. 

Since the sequence transformations, which are listed in theorem 12-9, are all exact for the 
geometric series, it is not surprising that they are also able to accelerate linear convergence. 

Theorem 12-10: The sequence transformations uj^\j3,Sn), eq. (7.3-5), t')^\j3,Sn), eq. (7.3-7), 

(/?,«„), eq. (8.4-2), Tl''\p,Sn),eq. (8.4-3), Y^''\j,Sn),eq. (9.4-2;, and T^^^ (7, s„), eq. (9.4- 

3), accelerate linear convergence if and only if Drummond's sequence transformation 'D^\sn, (-On), 
eq. (9.5-4), with ojn = cin accelerates linear convergence. 

The sequence transformations d^^\l3,Sn), cq. (7.3-9), 4"^(/3, s„), eq. (8.4-4), and A["'^(7, s„), 
eq. (9.4-4), accelerate linear convergence if and only if Drummond's sequence transformation 

uJn), eq. (9.5-4), with oJn = a„+i accelerates linear convergence. 

The sequence transformations 4 ^(/3)^n)) eq. (7.3-11), ^(/?, s^), eq. (8.4-5), and ^(Tj^w); 
eq. (9.4-5), accelerate linear convergence if and only if Drummond's sequence transformation 

'D^\sn,i^n)> eq. (9.5-4), with Un = andn+i/ {o,n ~ fln+i) accelerates linear convergence. 
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Proof: According to theorem 12-4 the sequence transformations mentioned above accelerate linear 
convergence if they possess limiting transformations which satisfy cq. (12.1-18). If we perform the 
limit n ^ oo in the explicit expressions for these sequence transformations according to cq. (12.1- 

3), we find that their limiting transformations G'^°°'* are Drummond's sequence transformation 
with LOn = an, oJn = On+i, Or Un = a„a„+i/ {an - ttn+i), respectively. 

Since Drummond's sequence transformation does not explicitly depend on n, this is at the same 
time the condition which determines whether P^"'''(s„,ci;„) with either a;„ = a„, a;„ = a^+i, or 
= anan+i/{an — ctn+i) accelerates linear convergence or not. 

Theorem 12-11: Drummond's sequence transformation V^\sn, i^n) > ^Q- (9.5-4), with either uJn = a^ 
LOn = <^n = '3(„a„+i/(a„ — a„+i) accelerates linear convergence for k > 1 and n >0. 

Proof: According to theorem 12-4 Drummond's sequence transformation P^"'^(s„,ll'„) accelerates 
linear convergence if Pfc(so,i^o) is exact for the sequence {[o"„(p)]}, eq. (12.1-23). The remainder 
estimate a;„ = a„ leads to w„ = the remainder estimate a;„ = a^+i leads to cOn = p", and 

the remainder estimate a;„ = a„a„+i/ (a„ — a„+i) leads to cOn = p"/ (1 — p). Since these remainder 
estimates arc all of the form of either eq. (12.2-5) or (12.2-6), it follows from theorem 12-8 that 

for A: > 1 'D^^\so,uJo) with either cOn = an, tOn = ^n+ii or ujn = anttn+i/ {an — cin-t-i) is exact for 
the sequence {[<7n(p)]}, eq. (12.1-23). This completes the proof of theorem 12-11. 

Similar results as in theorems 12-9 and 12-10 can also be derived for the analogous variants 
of the generalized transformations >C^"j(/9, s„,a;„), eq. (7.1-8), {P , Sn, LOn) , eq. (8.2-8), and 
Mg(7,s„,a;„), eq. (9.2-7), with £ > 1. 

12.3. A modification of Germain-Bonne's theory for sequence transformations 
involving remainder estimates. 

In the last section Germain-Bonne's formal theory of convergence acceleration was applied to 

those variants of the sequence transformations C^^\l3, Sn,(^n), eq. (7.1-7), sj^\/3,Sn,uJn), eq. 

(8.2-7), Ai^^\'y,Sn,iOn), eq. (9.2-6), and P^"^(s„,u;„), eq. (9.5-4), which are based upon Levin's 
[28] explicit remainder estimates (7.3-4), (7.3-6), and (7.3-10), as well as Smith and Ford's [29] 
modified remainder estimate (7.3-8). 

The sequence {[i^„]} of remainder estimates plays a central role in the sequence transformations 
mentioned above since its choice will ultimately determine success or failure. Experience shows 
that the simple remainder estimates (7.3-4), (7.3-6), (7.3-8), and (7.3-10) often work remarkably 
well in a variety of situations. However, one cannot expect that these simple remainder estimates 
will always lead to satisfactory results and in some cases it may well be much more efficient to 
use other remainder estimates {[wn]}. 

It is often possible to obtain explicit expressions for the remainders {[r^t]} of a sequence {[sn]}- 
Unfortunately, expressions of that kind are in most cases practically useless since they are normally 
too complicated. In some cases, however, it may be possible to derive with the help of simplifying 
assumptions, which are valid in the limit of large indices n, simple explicit expressions which can 
be used as remainder estimates {[o^n]}-. If such an explicit remainder estimate Un does not depend 
explicitly upon one or several elements of {[s„]}, the sequence transformations d^^\l3, Sn,ijJn), 

sj^\l3, Sn,u)n), '^k^\'y, Sn,^n), and (s„ , a;„) are linear sequence transformations. In addition, 
they are also defined and exact for constant sequences. 

In such a case, one would of course like to know how the two sequences {[sn]} and ^Un^ have 
to be related in order to guarantee at least the regularity of the transformation, and under which 
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circumstances the convergence of {[sn]} will be accelerated. These questions can at least partially 
be answered by a suitable modification of Germain-Bonne's theory. 

Our approach is inspired by a modification of Germain-Bonne's theory which can be found in 
Brezinski's first book (see pp. 126 - 132 of ref. [19]). Brezinski considered sequence transfor- 
mations which simultaneously act upon k + 1 consecutive elements of the sequence {[sn]} to be 
transformed and on A; -|- 1 consecutive elements of an auxiliary sequence {[a;„]}. Brezinski's modi- 
fication of Germain-Bonne's theory is suited for algorithms which remain well-defined if some or 
all elements of the auxiliary sequence {[x„]} are zero. This cannot be assumed here. 

It follows from eqs. (7.1-6), (8.2-6), (9.2-5), and (9.5-3) that the sequence transformations 

^^k\P,Sn,0Jn), S^^\l3,Sn,(^n), -M^"^ (7, Sn, Wn), and V^j^\sn,i^n) are aU of the form of cq. (12.2- 
2). If we assume that the remainder estimates {[i^rt]} do not explicitly depend upon the elements 
of {[s„]}, then it is a typical feature of the sequence transformations mentioned above that they 
are linear functions of their first A; -|- 1 variables. Consequently, these transformations are all 
continuous in their first k + 1 variables provided that the elements of {[.s„]} arc bounded. Much 
more critical is the continuity of these sequence transformations with respect to their second k + 1 
variables, the remainder estimates uin+i-, • • • , ojn+k- Since the remainder estimates always occur 
in denominators, the elements of {[wn]} must not be zero for all finite values of n. In addition, the 
remainder estimates have to be chosen in such a way that the denominator of such a sequence 
transformation, which is the fc-th difference of Pfc_i(n), a polynomial of degree < k—1 in ra, divided 
by (jJni will not vanish. Hence, a necessary but unfortunately not sufficient condition, which an 
admissible ]} of remainder estimates would have to satisfy, is that its elements are 

nonzero and distinct for all finite values of n. This implies that for every finite value of n a 
substring w^+i, . . . , ojn+k has to belong to a suitable subset of H'^"'"^, the intersection of F*^''"''" 
and ]D'=+^ 

(n) 

In this section stands for a sequence transformation which acts upon k + \ consecutive 
elements of a convergent sequence {[s.„]} and which also requires k+1 consecutive elements of 
a sequence {[tj^]} of remainder estimates. The superscript n indicates that F^"^ may depend 
explicitly upon n. 

(n) 

Hence, for fixed k € INq a sequence transformation F^ is a function which may depend 
explicitly on n G INq and which is defined on vectors x = (.xi, X2, . . . , x^+i) € IR'^'^^ and 
z = {z\, Z2-I ■ ■ ■ ,ZkJ^i) G H'^"''^. In addition, we assume that such a sequence transformation 

possesses for fixed k G INq and for all n G INq the following properties: 

(A-0): F^"'' is defined and continuous on a subset of ]R^~^^ x 

(n) 

(A-1): F^ is a homogeneous function of degree one in its first k + 1 variables and a liomogeneous 
function of degree zero in its second A; -|- 1 variables. Tliis means tiiat for all vectors x G M^'^^ 
and z G H*'"'"^, for wliicli is defined and continuous, and for allX^ji G JR with /j, ^ we have 

F^"^(Aa;i, Xx2,..., Xxk+i | Zi, ^2, • • • , -Zfc+i) 

= AF^"^(xi,X2, . . . I ^1,22, • • • ,^fc+i) , (12.3-la) 

^k'\xi,X2, . . . , Xfc+i \HZI,I^Z2,..., /i^fc+l) 

= F^"'^(xi,X2, . . . ,XA:+i I Zi,Z2, . . . ,2:^+1) . (12.3-lb) 

(A-2): F^"^ is linear in its first k + 1 variables. Consequently, for all vectors x, y G IR^~^^ and z G H^"*"^, 

(n) 

for which is F^ defined and continuous, we have 
F^"^(xi + yi,X2 + 2/2, • • ■,Xk+i + Vk+i I zi,Z2, Zk+i) 

= F^"^(xi,X2,...,Xjk+i|2;i,Z2,---,2;ifc+i) + F^"^(yi,y2,---,2/jk+i|2;i,Z2,...,2;jfc+i). (12.3-2) 
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(A-3): Let c = (c, c, . . . , c) G M^'^^ be a vector with constant components and let z belong to the subset 
of S^'^^ for which is defined and continuous. Then, is exact, i.e., 

r'j^\c,c,...,c\zi,Z2,...,Zk+i) = c. (12.3-3) 

(A-4): There exists a subset of H^^^ such that for all bounded vectors x G 1R^~^^ and for all vectors z 
belonging to this subset the limiting transformation 

tI^\xi,X2, . . . , Xk+1 \ZI,Z2,..., Zk+l) 

lim r^J'\xi,X2,...,Xk+i\zi,Z2,...,Zk+i) (12.3-4) 

n— >oo 



is uniquely defined and continuous on this subset oflR^~^^ X H*^"*""^. In addition, it is assumed that 
the limiting transformation r^°°^ is also homogeneous and linear according to (A-1) and (A-2). 

(n) 

Similarly as in the case of the sequence transformations it cannot be assumed that a 
sequence transformation F^"'' and its limiting transformation r^°°'* will be defined and continuous 
on the same subset of IR'^+^ x H'^"'"^. 

It follows from their explicit expressions that the sequence transformations C^^\p, s„, w„), eq. 

(7.1-7), Sj^\0,sn,u;n), eq. (8.2-7), M^^Hl, Sn,u;n), eq. (9.2-6), and Pj^")(s„, a;„), eq. (9.5- 
4), satisfy (A-0) - (A-4) if suitable sequences {[oj^]} of remainder estimates are used. Since 
these transformations are linear functions of the k + 1 sequence elements Sn, Sn+i, ■ ■ ■ , Sn+k if 
the elements of {[wn]} do not depend explicitly upon the elements of they are defined 

and continuous for arbitrary sequences {[s^]} if the elements of {[wn]} are nonzero for all finite 
values of n and if the remainder estimates are chosen in such a way that the denominators 
of these transformations do not vanish. The denominators of £[,"^(/3, s„, a;„), 5^"''(/3, s„, u;„), 
M^f^\'y,Sn,uJn)i and (s„, a;„), which are all of the type of eq. (12.2-2), will be nonzero for all 
k,n ^ JNq if the remainder estimates satisfy A'^{Pk-i{n)/cOn) 7^ 0. In the case of C^f^\p, Sn,u}n)i 
we have according to eq. (7.1-6) Pfc_i(n) = (n + /3)'^~'^, in the case of <S^"''(/3, s„,u;„) we have 
according to eq. (8.2-6) Pk-i{n) = (?i + /3)fc-i, in the case of A1^"^(7, s„, a;„) we have according 

to eq. (9.2-5) Pfc_i(n) = (— n — 7)^-1, and in the case of X'|."^(s„, a;„) we have according to eq. 
(9.5-3) Pk-i{n) = 1. 

We arc now in a position to formulate an analogue of theorem 12-2 for sequence transformations 
of the type T^"^ : IR'^+i x H'=+^ JR. 

(n) 

Theorem 12-12: Every sequence transformation F^, , which is defined and continuous for all vectors 
X € ]R^~^^ and for all z belonging to a suitable subset of H'''^^ and which also satisfies (A-0) - (A-4), 
can be expressed in the following way: 



r^"^ (Xi , X2 , . . . , Xfc+i \zi,Z2,..., Zk+i) 

(n) f X2-X1 Xk+1 - Xk 

= Xi + Zijl'[ , . . . , 

\ Zl Zk 



^,...,^]. (12.3-5) 

Zl Zk 



The associated transformation Jk^\ which is defined and continuous on a suitable subset of ^ X , 
is given by 



(n) / X2 
% 



/ X2 - Xi Xk+1 - Xk £2 Zk+l \ 

V Zl Zk Zl Zk J 



k-l j-1 



= rf o,^^^,...,5;^^±^^^n^ i,^,...,n^)- (12.3-6) 



Zl Zj+l -^-^ Zi+1 



k—i 

Z2 T-r Zj+2 



Zl 



=0 ^^+1 
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Proof: It follows from (A-2) and (A-3) that F^^^ is invariant under translation in the sense of eq. 
(3.1-4). Consequently, we can subtract xi from r^."'^ Since by assumption zi / 0, it follows from 
(A-1) that we can divide the 2A; -|- 2 arguments of F^,"-* by zi. This yields: 



r^"^(a;i, X2, . . . , Xk+i \zi,Z2,..., Zk+i) 
= xi + ziTl' 10, 



1,^,...,^). (12.3-7) 

Zl Zl 



Zl Zl 

We now need the following two relationships which can be proved quite easily: 

zu+i =]T£i±^, ^eiNo, (12.3-8) 

- XI ^ X,+2 - Xj+1 Z_^ ^ ^^^^ 

If we insert eqs. (12.3-8) and (12.3-9) into eq. (12.3-7) we obtain eqs. (12.3-5) and (12.3-6). 
The continuity of 7^"^ on a suitable subset of IR'^ x IF'^ follows from the continuity of F^"^ on a 
subset of ]R'=+^ X H'^+i via eq. (12.3-5). 

With the help of theorem 12-12 it can be analyzed for which convergent sequences {[^n]} and 

for which sequences ^con^ of remainder estimates a sequence transformation F^"^ satisfying (A-0) 
- (A-4) will be regular. 

(n) 

Theorem 12-13: Let F^ ' be a sequence transformation which satisGcs theorem 12-12. This means that 

(n) 

according to eqs. (12.3-5) and (12.3-6) an associated transformation 7^ exists which is continuous 
on a suitable subset of X F^. Let us assume that a sequence ^Sn^ converges to some limit s, and 
that the elements of a sequence ^OJn^ of remainder estimates although they are different from zero 
for all finite values of n - approach zero as n — ^ 00. Then, is regular if the elements of -{[sn]} 
and {[w^]} satisfy: 

(i) : For sufEciently large values ofnE INq the ratios As„/a;„ are all bounded, i.e., 

\Asn/uJn\<c, 0<c<oo. (12.3-10) 

(a): For all bounded vectors y = {yi,y2, ■ ■ ■ ,yk) ^ the associated transformation 7^"^ remains 
bounded as n oo: 



lim 

n— »oo 



< M, < M < 00. (12.3-11) 



Proof: It follows from eq. (12.3-5) that F^"^ can be written in the following way: 

)'^n+fc) 



-p{i^) I I 
k v'^" ' 1 • • • 1 ^n-\-k \ j j 



Sn + i^n % 



in) 



^^n+k-1 



(12.3-12) 
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According to eq. (12.3-6) the associated transformation is given by 



(n) / ASn+k-1 
I ) • • • ) 

LOn ljJn+k-\ 



<^n ^n+k-1 



= ri'^)('o,^f!i±l,....y^f^ tf^^^!^ l,^,...U'±±2±l]. (12.3-13) 

r[."^ preserves the convergence of {[sn]} to its limit s if the second term on the right-hand side 
of eq. (12.3-12) vanishes as n — oo. Since {[cun]} approaches zero as n — oo, we only have to show 

that the associated transformation 7^"^ remains bounded as n — 00. Since F^"^ is according to 

(A-2) linear in its first k-\- \ components, we may conclude from eq. (12.3-13) that 7j[.°°^ is bounded 
for all n G INq if its Ik arguments remain bounded as n ^ 00, and if it remains continuous in its 
second k variables as ra — > 00. It follows from (i) and (ii) that this is indeed the case which proves 
theorem 12-13. 

If we compare theorem 12-13 with the analogous theorem 12-3, which formulates criteria for 
the regularity of sequence transformations G^"^ : H'^"'"^ IR, we see that theorem 12-13 is quite 
liberal with respect to the set of admissible sequences {[sn]} since only convergence to some limit 
is assumed. However, given a convergent sequence {[sn]}, the criteria, which have to be satisfied 
by an admissible sequence {[wn]} of remainder estimates, are quite restrictive. 

The next theorem deals with the acceleration of linear convergence by sequence transformations 

(n) 

Fj, ' . The following theorem is virtually identical with the analogous theorem 12-4 which deals 

(n) 

with sequence transformations G\ . In both cases the decisive criterion is that the limiting 

transformations r[,°°^ and G^^'^ have to be exact for a shifted sequence of partial sums of the 
geometric series. This again emphasizes the importance of the geometric series for a theoretical 
analysis of the acceleration of linear convergence. 

Theorem 12-14: Let us assume that the elements of the sequences {[sn]} and ^LOn^ satisfy: 

(12.3-14) 

c, c^O, (12.3-15) 
p, 0<\p\<l. (12.3-16) 



(i) ■■ 


lim 






n— >oo 


(ii) : 


lim 


Sn S 


n— »oo 




(Hi): 


lim 




n— >oo 





Then, a necessary and sufficient condition that a sequence transformation F^ accelerates the con- 
vergence of the sequence is that its associated transformation 7^"^ satishes: 

lim jl^\yn,yn+l, ■ ■ • ,2/n+fe-l I Zn,Zn+l, ■ ■ . , Z^+k-l) 



n^oo 



= ik°\y,y,---,y\z,z,...,z) = (12.3-17) 

Here, {[yn]} and {[-Zn]} are essentially arbitrary sequences which converge to y and z, respectively The 
above statement can also be formulated in terms of the limiting sequence transformation F^^^; 



lim 

n—i-oo 



, k-1 j-1 k-1 X 

■'^1"^ f 0) ■ ■ ■ ) ^ yn+j JJ Zn+i 1, 2;„, . . . , JJ Zn+j j 
^ j=0 i=0 j=0 ' 



j=0 i=Q 

k-1 



Tr{0,y,...,y:^z^ 

3=0 



1,^,...,/) = 0<|z|<l. (12.3-18) 
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Proof: If we subtract s from both sides of eq. (12.3-12) and divide the resulting expression by 
Sn — s we obtain: 

\sn, Sn+1, • • • , Sn+fc | ^n,i^n+li ■ ■ ■ j^n+k) — S 



1 , (n) / ASn ASn+k-1 



Sr,. — S \ LOr,. LO, 



UJ„ LO. 



'n+k-l 



(12.3-19) 



According to eq. (2.6-6) the convergence of a sequence {[s„]} to its hmit s is accelerated by a 
sequence transformation T^^^ if 

^k^H^n, Sn+1, ■ ■ ■,Sn+k \^^n,i^n+l, ■ ■ ■ ,^n+fc) - S ^ ^ 3_2q^ 
n— >cx) Sjj — S 

Hence , if we perform the limit n — > oo in eq. (12.3-19), the left-hand side has to vanish if F^"^ 
accelerates convergence. Thus, we only have to investigate under which conditions the right-hand 
side of eq. (12.3-19) also vanishes as n ^ oo. It follows from eq. (12.3-15) that ujn/{sn — s) 1/c 
as n — > oo. In addition, it follows from eq. (12.3-16) that the second k arguments of the associated 
transformation 7^^"^ all approach p as n ^ 00, and with the help of eqs. (12.3-15) and (12.3-16) 
we find that the first k arguments of 7^^"^ all satisfy: 

lim ^ = lim l^^fl^l^ _ flL^l = c{p-l). (12.3-21) 

n^oo iOn n^oo [ ujn OJn+l <^n J 



Hence, if we perform the limit n ^ 00 in eq. (12.3-19) we find: 

1 + -7i°°^(c(p-l),c(p-l),...,c(p-l)|p,p,...,p) =0. (12.3-22) 



c 



Now we only have to set c(p — 1) = y and p = z'm. order to see that if a sequence transformation 

r^"^ accelerates the convergence of {[sn]}, then its associated transformation has to satisfy eq. 
(12.3-17). In the same way, if cq. (12.3-17) is satisfied by the associated transformation of a 

sequence transformation r^"\ then it follows from eqs. (12.3-15), (12.3-16), and (12.3-19) that 

r^"'' accelerates the convergence of {[sn]} according to eq. (12.3-20). This proves theorem 12-14. 

First, it should be remarked that condition (ii), eq. (12.3-15), is identical with eq. (7.3-1). This 
is another confirmation that the elements of a sequence of remainder estimates should be chosen 
in such a way that LJn is proportional to the leading term of an asymptotic expansion of Sn — s as 

n ^ CO. 

The first k + 1 arguments of r[°°^ in cq. (12.3-18) arc apart from the factor y identical with 
the elements of the sequence {[o"„(z)]} which are defined by eq. (12.1-23). Consequently, the 
right-hand side of eq. (12.3-18) can be rewritten in the following way: 



-,(00) 



rr(0,2/,...,yy 



1 - z 



l,z,...,z*^) = ^-3^, 0<|^|<1. (12.3-23) 



Next, theorem 12-14 will be used to prove that the sequence transformations C^^\p,Sn,0Jn), 
eq. (7.1-7), 4")(/3,s„,a;„),eq. (8.2-7), ^^^"^(7, s„, a;„), eq. (9.2-6), and pj^'^)(s„, a;„), eq. (9.5-4), 
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are able to accelerate linear convergence if the remainder estimates are chosen in such a way that 
LOn is proportional to the leading term on an asymptotic expansion of s„ — s as n — > oo. 

Theorem 12-15: We assume that a sequence transformation can be written in the follow- 

ing way: 

Tl^''\sn,0Jn) = , k,nelNo. (12.3-24) 



E(-i)^(-)A(-+i) 



j=0 

If the sequences {[sn]} and {[wn]} are as in theorem 12-14 and if the coefEcients fk{n) satisfy 

lim fk(n) = 1 , kelNo, (12.3-25) 

n— »oo 

then T^\sn,u)n) accelerates the convergence of {[sn]} for k>l. 

Proof: According to theorem 12-14 we have to show that the Umiting transformation 
satisfies cither cq. (12.3-18) or (12.3-23). However, the limiting transformation of all sequence 

transformations T^\sn,uJn) satisfying eqs. (12.3-24) and (12.3-25) is Drummond's sequence 

transformation v'^^\snjU)n), eq. (9.5-4). Consequently, it is sufficient to show that Drummond's 
sequence transformation is exact for the sequence y{cFn{z)\, with •{[cr„(2;)]| defined by eq. (12.1-23), 
if the remainder estimates Un = z'^ are used, i.e., 

^ ^k\ y 1 — z^ 



j=0 



3 J 1 



' /a 1 1-^ 



(12.3-26) 



J/ 



The numerator sum in eq. (12.3-26) may be rewritten in the following way: 

G) - Thp-^y G) h - Thp-^y G)- 

It follows from eq. (2.4-8) that the second sum on the right-hand side is zero for k > 1. This 
shows that eq. (12.3-26) is correct and proves theorem 12-15. 

It can be deduced directly from their explicit representations that £^"^(/3, s„, u;„), eq. (7.1-7), 

(8.2-7), m(^)(7, LOn), eq. (9.2-6), and 'D''^\sn,uJn), eq. (9.5-4), satisfy 
eqs. (12.3-24) and (12.3-25). In addition, it can be shown that the generalized transformations 

C^,^j{f5,Sn,uJn), eq. (7.1-8), 5^"^^(/3, s„, u;„), eq. (8.2-8), and Al^"](7, Wn), eq. (9.2-7), with 
i > 1 also satisfy eqs. (12.3-24) and (12.3-25) for sufficiently large values of k. Consequently, 
these sequence transformations accelerate the convergence of a linearly convergent sequence {[sn]} 
if the remainder estimates ^Un^ are chosen in such a way that conditions (i) - (iii) of theorem 
12-14 are fulfilled. 
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It is in fact by no means trivial that the generahzed sequence transformations C^^j{P, Sn,(jJn), 

^k^eiP^^n^^n): ■M^^j{'j,Sn,u;n) with £ >l also accelerate convergence if the sequences {[s„]} and 
{[a;„]} satisfy conditions (i) - (iii) of theorem 12-14. It follows from the model sequences (7.1-10), 
(8.2-10), and (9.2-9) that these transformations were derived assuming that Sn — s ^ Pi{n)u)n as 
n ^ oo with Pi{n) being a polynomial of degree i in n. However, in theorem 12-14 it is assumed 

that s„ — s ~ a;„ as n — J- cxD. Hence, we see that sequence transformations T'^\sn,'j^) satisfying 
eqs. (12.3-24) and (12.3-25) accelerate linear convergence even if instead of the "right" sequence 
{[cjn]} of remainder estimates a "wrong" sequence {[o;^]} of remainder estimates witha;^ = P^(n)a;„ 
with I G INo is used. 

This behaviour is quite typical of all sequence transformations of the type of eq. (12.2-2) which 
are defined as ratios of finite differences. 

With the help of the following theorem it can also be shown that the sequence transforma- 
tions £^"^(/3, s„,u;„), eq. (7.1-7), 5^"^(/3, s„, c^^), cq. (8.2-7), A^^"^ (7, s„, u;„), cq. (9.2-6), and 
P^"'^(s„, Wn), eq. (9.5-4), as well as the generalized transformations £^"](/3, s„, a;„), eq. (7.1-8), 

S^^{l3,Sn,iOn), eq. (8.2-8), and A^^'^j (7, s„, c<;„), eq. (9.2-7), with i > 1 are all exact for the 
geometric series. 

Theorem 12-16: We assume that a sequence transformation T^"'' (s„, a;„) can be written in the follow- 
ing way: 

^(sn,a;n) = V ' k,ne]No. (12.3-28) 



(Pk-i{n + j) 



3 J ^n+j 

If for sufEciently large values of k the coefficients (pk-iin) are polynomials of degree < k — 1 in 
n, then for sufEciently large value of k such a sequence transformation Tjf^\sn,(-On) is exact for the 
partial sums of the geometric series, eq. (2.6-2), if the remainder estimates are chosen according to 

oj^ = with ae M. 

Proof: The numerator polynomial in eq. (12.3-28) can then be rewritten in the following way: 



j=0 

1 ^ . ... A 



j^i-^y ('')^k-i{n + j). (12.3-29) 



Z° (1 - Z, 

Let us now assume that k is large enough such that (/3/fc_i(n) is a polynomial of degree <k — \ 
in n. Then it follows from eq. (2.4-8) that the second sum in eq. (12.3-29) vanishes. This proves 
theorem 12-16. 

Obviously, all sequence transformations mentioned above satisfy the prerequisites of theorem 
12-16. 
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12.4. A critical assessment of Germain-Bonne's theory 

With the help of either the original version of Germain-Bonne's formal theory of convergence 
acceleration or its modifications it can be decided whether a sequence transformation is regular, 
i.e., whether the transformed sequence {[s^i]} converges to the same limit as the original sequence 
{[s„]}. In addition, a necessary and sufficient condition could be formulated by means of which it 
can be decided whether a sequence transformation is able to accelerate linear convergence or not. 
Theoretically, these results are certainly remarkable achievements, in particular since for their 
derivation only some very general properties of the sequence transformation such as continuity, 
homogeneity, and translativity had to be assumed. Also, concerning the sequences {[sn]}) which 
are to be transformed, only relatively little has to be assumed. In most cases it is sufficient 
that the sequences converge or - if the acceleration of linear convergence is analyzed - that they 
converge linearly. 

However, it must not be overlooked that Germain-Bonne's formal theory of convergence ac- 
celeration has some serious shortcomings which definitely limit its practical usefulness, although 
it certainly is a beautiful mathematical theory. For instance, the generality of Germain-Bonne's 
theory and its modifications - although highly desirable from a theoretical point of view - is at 
the same time a major weakness since it implies that the results of this theory are quite general 
and cannot be as specific as one would like them to be. 

Germain-Bonne's theory is only able to make statements as for instance that a sequence 
transformation is regular or that it is able to accelerate linear convergence. However, from a 
practical point of view the statement that a given sequence transformation is able to accelerate 
linear convergence is just as useful - or as useless - as the statement that a given series converges. 

Germain-Bonne's theory is essentially asymptotic in nature because only the sequence elements 

(n) (n) 

Sn and the transforms G^. or with large values of n matter. This asymptotic nature is 
essential because it makes a theoretical analysis possible. However, it refers to a situation — 
sequence elements s„ or transforms s'^ with large indices n - which one would like to avoid by 
using sequence transformations. In addition, the predictive value of an asymptotic theory is often 
quite limited. A given numerical technique need not be particularly powerful for moderately large 
values of n, let alone for small values of n even if it is guaranteed that this technique will work 
well in the limit n — > oo. 

In actual computations only a relatively small number of sequence elements will normally be 
known, say ,s„, .... s^+fc, and one would like to know how the information, which is contained 
in these sequences elements, can be extracted and utilized in an optimal way. Here, Germain- 
Bonne's theory or its variants cannot help at all since it does not discriminate among sequence 
transformations which all have the same properties in the limit n — > oo. For instance, according 
to theorem 12-10 certain variants of the sequence transformations C^^\(5,Sn,^n), eq. (7.1-7), 
S^^\l3,Sn,ujn), eq. (8.2-7), and Al[,"'^(7, s„, lj„), eq. (9.2-6), are able to accelerate linear conver- 
gence if and only if the analogous variants of Drummond's sequence transformation P^"'*(s„, a;„), 
eq. (9.5-4), are able to accelerate linear convergence. Consequently, Drummond's sequence trans- 
formation plays a very important role in our modification of Germain-Bonne's formal theory of 
convergence acceleration since it allows a unified treatment of a large class of sequence transforma- 
tions. But it is wrong to assume that Drummond's sequence transformation will be particularly 
useful in actual computations. In fact, we shall see later that Drummond's sequence transfor- 
mation is normally significantly less powerful than the other sequence transformations mentioned 
above. 

Germain-Bonne's theory is essentially a successful theory of the acceleration of linear conver- 
gence and it does not help at all if for instance logarithmic convergence is to be accelerated. This 
is quite deplorable since the acceleration of logarithmic convergence is a much more annoying 
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problem than the acceleration of linear convergence - both theoretically and computationally. 

Another problem of great practical relevance is the determination of the antilimit s of a divergent 
sequence {[sn]} by employing a suitable sequence transformation or T^,"''. In such 
formal theory, which involves a limit n — > oo, makes no sense. Instead, any theoretical analysis 
of such a summation process would have to say something about the convergence of a sequence 
of transforms G^^^ or F^"^ to the antilimit s and how this convergence is affected if the subscript 
k is increased while the superscript n is held fixed. Again, Germain-Bonne's theory and its 
modifications cannot contribute anything. 

Hence, Germain-Bonne's theory of convergence acceleration is not able to treat several problems 
of great practical relevance and has to be supplemented by other theoretical approaches. However, 
it is not likely that Germain-Bonne's theory can be improved significantly without making much 
more detailed assumptions about both the sequence transformations, which are to be analyzed, 
and the sequences, which are to be accelerated or summed. 
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13. Summation and convergence acceleration of Stieltjes series 

13.1. Stieltjes series and Stieltjes functions 

This section deals with the summation of divergent asymptotic series, as they for instance 
occur in the theory of special functions or in quantum mechanical perturbation theory. It is well 
known that a given function f{z) admits at most one asymptotic power series. The converse, 
however, is not true, i.e., it may happen that there are several different functions which all admit 
the same asymptotic power series. In a theoretical analysis of summation processes, the possible 
nonuniqueness of asymptotic expansions is certainly quite annoying and the set of admissible 
asymptotic series should be suitably restricted in order to avoid these complications. 

These nonuniqueness problems can be avoided in the case of Stieltjes series which assume an 
exceptional position among divergent series. For Stieltjes series there exists a highly developed 
convergence and representation theory (see refs. [18,22,79,95,96]). For instance, it can be shown 
that Fade approximants are able to sum even wildly divergent Stieltjes series if the terms an of 
these series do not grow faster in magnitude than c^'^^{2n)\ as n ^ oo with c being a suitable 
positive constant (see theorems 1.2 and 1.3 of rcf. [87]). This implies that Fade approximants 
are able to sum the divergent Euler series, eq. (1.1-7), which is, as we shall see later, a Stieltjes 
series. 

Stieltjes series are also of considerable physical interest since many quantum mechanical per- 
turbation expansions arc Stieltjes scries. For instance, it could be proved rigorously that the 
Rayleigh-Schrodinger perturbation expansions for the energy eigenvalues of the quartic anhar- 
monic oscillator are Stieltjes series [86,97]. It also follows from the asymptotic behaviour (1.1-5) 
of the perturbation series coefficients that Fade approximants are able to sum the divergent 
perturbation series (1.1-4) for the ground state energy of the quartic anharmonic oscillator. 

In this section, the summation of divergent Stieltjes series by means of nonlinear sequence trans- 
formations will be investigated both theoretically and numerically. It will be one of the main re- 
sults of this section that the sequence transformations £j."'^(/3, s„, a;„), eq. (7.1-7), S^\(i,Sn,0Jn)^ 
eq. (8.2-7), and A^^"^(7, s„, a;„), eq. (9.2-6), which all require a sequence {[aj„]}- of remainder esti- 
mates for their computation, sum divergent Stieltjes series much more efficiently than for instance 
Fade approximants, which may be computed with the help of Wynn's e algorithm, eq. (4.2-1), 
or also Brezinski's ■d algorithm, eq. (10.1-9). This is probably due to the fact that in the case of 
a Stieltjes scries it is comparatively easy to find simple remainder estimates {[ci^n]}, which may be 
used in the sequence transformations mentioned above and which in spite of their simplicity yield 
rigorous and tight upper bounds for the remainders of truncated Stieltjes series. 

In order to make this section more self-contained, first those properties of Stieltjes series and 
Stieltjes functions, which are of particular importance for our purposes, will be reviewed. 

A function f{z) with z G C will be called Stieltjes junction if it can be expressed as a Stieltjes 
integral, 

= r YTl. |arg(z)|<7r. (13.1-1) 

Jo 1 + zt 

Here, '4){t) is a positive measure on < t < oo which has for all m G INq finite and positive 
moments jim defined by 

poo 

Urn = / f^dipit), meWo. (13.1-2) 
Jo 

A formal series expansion of the following type, which need not be convergent, 

oo 

f{z) = J2 {-iri^mZ''\ (13.1-3) 
m=0 
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is called a Stieltjes series if its coefficients /x^ are moments of a positive measure ijj{t) onO < t < oo 
according to eq. (13.1-2), i.e., 

poo 

/(^) = E (-ir^" / t^^mt)- (13.1-4) 

m=0 

A good example for a Stieltjes function with a wildly divergent Stieltjes series is the so-called 
Euler integral, eq. (1.1-6), and its associated asymptotic series, the so-called Euler series, eq. 
(1.1-7). 



Theorem 13-1: Every Stieltjes function f{z) can be written in the following way: 

foo 

m=0 



fiz) = ^(-l)™/x^z- + (-z)"+i / — — |arg(z)|<7r. (13.1-5) 



Proof: We only have to insert the relationship 



^ X- = (13.1-6) 

m=0 

with X = —zt into eq. (13.1-1) and do the moment integrals according to eq. (13.1-2). 

Whether a Stieltjes series converges or diverges depends upon the behaviour of the remainder 
integral on the right-hand side of eq. (13.1-5). The next theorem shows that this remainder 
integral is bounded by the first term of the power series (13.1-3) which was not included in the 
partial sum in eq. (13.1-5). This bound will also help us to find a simple and - as we shall see 
later - efficient sequence of remainder estimates for the sequence transformations >C^"'''(/3, s„, u;„), 
eq. (7.1-7), 5f^(/3,.s„,a;„), eq. (8.2-7), (7, Sn, c^n), eq. (9.2-6), and p["^(sn,a;n), eq. (9.5-4). 

Theorem 13-2: The remainder term in theorem 13-1, 

satisfies depending upon the value of'd = arg(2;) tie following inequalities: 

|^n(^)| < /^n+ik"+'|, \^\<7r/2, (13.1-8a) 

\Rn{z)\ < Hn+1 cosec ??| , 7r/2 <\^\<7r. (13.1-8b) 

Proof: Setting z = re^^ gives 

\l + zt\= [l + 2rtcos'& + r'^fY^'^ . (13.1-9) 

Next, one has to look for the value of t with < t < 00 for which |1 + zt\ assumes its minimal 
value. Differentiation with respect to t gives the extremal condition 

t = - ^ . (13.1-10) 

r 

Now, two different cases have to be distinguished: 
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(i) : \'&\ < vr/2. Then, cos-d > 0. Consequently, |1 + zt\ assumes its minimal value for t = and 

wc obtain the estimate (13.1-8a). 

(ii) : 7r/2 < \^\ < tt. Then, cos?? < 0. Combination of eqs. (13.1-9) and (13.1-10) yields 

\sm'&\<\l + zt\. (13.1-11) 

If this inequality is used in eq. (13.1-7), estimate (13.1-8b) follows. This shows that theorem 
13-2 is correct. 

It also follows from theorem 13-2 that every Stieltjes function possesses an asymptotic series 
valid uniformly in every sector |arg(2:)| < i? for any < tt and that this asymptotic series is 
a Stieltjes scries (see p. 398 of ref. [86]). It can also be proved that for every Stieltjes series 
there exists at least one associated Stieltjes function. Since this possible nonuniqueness is very 
inconvenient in summation processes, a criterion would be needed which makes it possible to 
prove that there is a one-to-one correspondence at least between certain divergent Stieltjes series 
and certain Stieltjes functions. Thus, a condition would be needed which is stronger than the 
existence of an asymptotic power series of the type of eq. (13.1-3) but weaker than the existence 
of a convergent Stieltjes series. 

On the basis of Carleman's theorem (see p. 39 of ref. [98]) a sufficient condition can be 
formulated which guarantees that there exists a one-to-one correspondence between a Stieltjes 
function and its associated asymptotic series. 

A Stieltjes function f{z), which is analytic in a sectorial region of the complex plane, is said to 
satisfy a strong asymptotic condition and its associated Stieltjes series is called a strong asymptotic 
series if suitable positive constants A and ^ can be found such that 



< AC+\n + l)\\z\''+^ (13.1-12) 



holds for all n G JNq and for all z in this sectorial region. 

The validity of such a strong asymptotic condition implies that a Stieltjes function f{z) is 
uniquely determined by its asjnuptotic series (see p. 40 of ref. [98]). Such a strong asymptotic 
condition can only be valid if the Stieltjes moments Hn, which are defined by eqs. (13.1-3) and 
(13.1-4), satisfy for ah n G INq (see p. 43 of ref. [98]) 

< ACn\. (13.1-13) 

The moments of the Euler series, eq. (1.1-7), satisfy this inequality. Hence, we may conclude 
that the Euler integral, eq. (1.1-6), is uniquely determined by its asymptotic series (1.1-7). In 
the same way, it follows from the asymptotic behaviour (1.1-5) of the series coefficients that the 
perturbation series (1.1-4) for the ground state energy of the quartic anharmonic oscillator is 
a strong asymptotic series. Consequently, the ground state energy of the quartic anharmonic 
oscillator is uniquely determined by its divergent perturbation series (see also p. 41 of ref. [98]). 

However, there are Stieltjes series of considerable physical interest which have moments /in that 
behave like (kn)] with > 1 as n — > oo. For instance, in the case of the perturbation expansions 
for the energy eigenvalues of the sextic or octic anharmonic oscillator there is ample numerical 
evidence that the coefficients of these series grow as (2n)! or (3n)!, respectively, as n oo (see p. 
43 of ref. [98]). Obviously, a strong asymptotic condition cannot be valid in such a case. However, 
it can be shown (see p. 43 of ref. [98]) that a function f{z), which is analytic within a sectorial 
region of the complex plane, is also uniquely determined by its asymptotic series if f{z) satisfies 
a modified strong asymptotic condition of order k and if its asymptotic series is a modified strong 
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asymptotic series of order k. This means that suitable positive constants A and ^ can be found 
such that 

n 

/(^) - E (-1)"-"-^" < AC+'[k{n+l)]\\z\''+^ (13.1-14) 

m=0 

holds for all n € INq and for all z in this sectorial region. 

Again, such a modified strong asymptotic condition of order k can only be valid if the Stieltjes 
moments /x„ satisfy for all n G INTq (see p. 406 of ref. [86]) 

/Xn < A^'^{kn)\. (13.1-15) 

The bounds for the remainders Rn{z) in theorem 13-2 are also of considerable importance for 

convergence acceleration and summation processes because it helps us to find simple and manage- 
able remainder estimates {[w„]}. Because of the specific structure of the sequence transformations 

C^^\p,Sn,tOn), S^k'\P,Sn,u;n), Al^""* (7, s„, a;„), and V^^\sn, tOn) , ah those quantities which are 
independent of n, do not have to be included in the remainder estimate a;„. Consequently, it is 
not necessary to distinguish the two different cases < vr and 7r/2 < {i^l < it in theorem 13-2 
and for every sector | arg(2:)| < with 1? < vr a suitable estimate Un for the remainder Rn{z) of a 
Stieltjes series would be 

ojn = (-l)"+Vn+i neJNo. (13.1-16) 

This choice is identical with the remainder estimate (7.3-8) of Smith and Ford [29]. Hence, for 
the summation of divergent Stieltjes scries the most natural choices among the numerous variants 

of the sequence transformations jC^ ■'(/?, s^, i^rt); Sn, iOn), and {'j, Sn, LO-ri) would be the 

transformations 4"^(/3,s„), eq. (7.3-9), 6'^\/3,Sn), eq. (8.4-4), and A'j^\j,Sn), eq. (9.4-4). 



13.2. Theoretical error estimates 

In this section theoretical error estimates for the summation of a divergent Stieltjes series by 
means of nonlinear sequence transformations will be derived. However, the error estimates of this 
section can also be applied if the convergence of sequences with strictly alternating remainders is 
accelerated. 

There are only relatively few references in the literature in which the summation of divergent 
Stieltjes scries by means of nonlinear sequence transformations is analyzed. In articles by Wynn 
[99], Common [100], Allen, Chui, Madych, Narcowich, and Smith [101], and Karlsson and Sydow 
[102] the Fade summation of Stieltjes series was analyzed. Then, there is an article by Sidi 
[103] on the summation of certain wildly divergent series by Levin's u and t transformations, 
eqs. (7.3-5) and (7.3-7). Sidi could show that if the divergent series satisfies certain conditions, 
Levin's u and t transformation produce sequences of approximants which converge to the Borel 
sum of the divergent series. Other sequence transformations were apparently not yet treated 
in the literature. This is not too surprising since many nonlinear sequence transformations as 
for instance Brezinski's t!) algorithm, eq. (10.1-9), are defined by relatively complicated recursive 
schemes and otherwise only very little is known about these transformations. Currently, a detailed 
theoretical analysis of the efficiency of such a sequence transformation in convergence acceleration 
and summation processes seems to be more or less impossible. 

However, sequence transformations of the type of eq. (12.2-2) can be analyzed relatively easily 
if suitable assumptions concerning the sequences {[sn]} and {[a;„]} are made. Consequently, in 
this section the emphasis will be on the sequence transformations £^"^(/3, s„, a;„), eq. (7.1- 
7), Si''\p,sn,u;n), eq. (8.2-7), ^^^"^(7, s„, a;„), eq. (9.2-6), and P^"^(s„, a;„), eq. (9.5-4), as 
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well as on the mild generalizations Cj^^^{P, Sn,ijJn), eq. (7.1-8), S^^^ {P, Sn,u)n), eq. (8.2-8), and 
A^^"](7, Sn,iOn), eq. (9.2-7). The following theorem will be the basis of our analysis. 

Theorem 13-3: Let us assume that a sequence transformation G^j^\sn, Sn+i, ■ ■ • , s^+k) with k,n £ 
J/Vq is invariant under translation according to eq. (3.1-4). Then a necessary and sufRcient condition 
that this sequence transformation is able to sum a divergent sequence {[s„]} to its antilimit s on a 
path V = ^{rij, kj)^ with j G Wq is that 

lim G^^'\sn^ - S, Sn^+i - S,..., Sn^+k, - s) = . (13.2-1) 

Proof: Since G^"'* is by assumption invariant under translation according to eq. (3.1-4), we have 
for arbitrary integers Uj and kj: 

G\cj'\^rij-i ^nj+l) • • • 5 Sfij+kj) = S + G\,^'\snj — S, — S, . . . , S^.^k. — s) . (13.2-2) 

Performing the limit j — > co shows that theorem 13-3 is correct. 

It can be proved quite easily by a typical 2e proof that if the antilimit s of a divergent series 
{[s„]} exists on a given path V, then it is uniquely determined on this path. For different paths, 
however, no general statement concerning the uniqueness of the antilimit s can be made. In 
summation processes, one is normally only interested in horizontal paths, i.e., in paths in which 
rij is ultimately constant and in which only kj is increased. Of course, theorem 13-3 can be 
reformulated in such a way that it applies to convergence acceleration processes. 

Theorem 13-4: Let us assume that a sequence transformation G^\sn, Sn+i, ■ ■ ■ ,Sn+fc) with k,n £ 

]Nq is invariant under translation according to cq. (3.1-4). Then a necessary and sufEcient condition 
that this sequence transformation preserves the limit s of a convergent sequence {[sji]} on a path 
V = iinj,kj)} with j G No is that 

^fe?'*^*"^ ~ ■^"^+1 ~ ^' • • • ' ^n^+kj - = • (13.2-3) 

What is gained if summation and convergence acceleration processes are analyzed with the help 
of theorems 13-3 and 13-4. Since the limit or antilimit s of a sequence {[sn]} is normally not known, 

it is in most cases very hard or even impossible to estimate, how close G^"^ (s„, Sn+ij • • • , Sn+fe) and 
s are. However, it will become clear in the sequel that it is frequently comparatively easy to obtain 
a theoretical estimate for the magnitude of the error term G^"^ (s„ — s, Sn+i ~ ■s, • • • , s^+k ~ ■s) and 
its dependence upon k and n. 

(n) 

Theorems 13-3 and 13-4 remain of course valid if the sequence transformation Gj^ , which only 
depends upon k+1 sequence elements s„, s^+i, . . . , s„+fc, is replaced by a sequence transformation 

(n) 

Fj, which in addition to the k + 1 sequence elements s„, Sn+ij ■ ■ ■ , Sn+k also depends upon k + 1 
remainder estimates oOn+i^ ■ ■ ■ , ^n+k- 

In this section we shall try to make some quantitative predictions about the magnitude of 
the summation error if a given sequence transformation, which is of the type of eq. (12.2-2), is 
used for the summation of a divergent Stieltjes series. Unfortunately, it seems that such an error 
analysis cannot be done in the case of a completely arbitrary Stieltjes series. However, if we apply 
sequence transformations of the type of eq. (12.2-2) to some suitably chosen model sequences, 
valuable insight into the mechanism as well as the power of these sequence transformations can 
be gained. 
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Our error analysis will be based upon theorems 13-3 and 13-4, i.e., we shall try to estimate the 
magnitude of the error term G^^\sn — s, Sn+i ~ . . . , Sn+k — s) and its dependence upon k and 
n. In addition, we assume that the sequences {[s^]} and {[w^]}- possess the following properties: 

(S-0): The elements of {[s n]} are the partial sums of an infinite series which either converges to some limit 

s or in the case of divergence can be summed to give s. 
(S-1 ): The elements of the sequence {[cUn]} of remainder estimates for -Jsn]} are strictly alternating in sign. 
(S-2): For all n G Wq the ratio {sn- s)/u n can be expressed as a factorial series, i.e., 



oo 



/3 G JR+ , n G Wo . (13.2-4) 



On the basis of these assumptions the summation of divergent Stieltjes series as well as the 
acceleration of the convergence of certain alternating series can be analyzed. 

Concerning (S-1) it should be remarked that if we chose the remainder estimates {[ajn]} according 
to eq. (13.1-16) then the positivity of the Stieltjes moments /x„ according to eq. (13.1-2) implies 
that we are restricted to power series with positive arguments z. If z would be an arbitrary 
complex number, it could not be guaranteed that our remainder estimates cjn will have strictly 
alternating signs if they are chosen according to eq. (13.1-16). 

The requirement that (s„ — s)/ujn can be expressed as a factorial series according to eq. (13.2-4) 
may appear to be somewhat restrictive. However, this is not necessarily more restrictive than the 
analogous requirement that («„ — s)/u;„ can be expressed as a series in inverse powers oi P + n, 

— °° c' 

^ = E(]J^. /'^K,. „e^„. (13.2-5) 

In Nielsen's book it is described how inverse power series and factorial series can be transformed 
into each other (see pp. 272 - 282 of ref. [77]). Assumptions (S-0) - (S-2) will now be used to 
obtain quantitative error estimates in summation and convergence acceleration processes. 

Theorem 13-5: Let us assume that the sequences {[sn]}- and ^cOn^ satisfy (S-0) - (S-2) and that the 

sequence transformation sj^ ^(l3,Sn^ 

uJn), eq. (8.2-7), is used for the transformation of {[sn]}- Then 
we obtain for fixed /c G IV and for all n G Wo the following estimate for the error term: 

OJn ^ Ck+j (j + l)k 



< 



E 

3=0 



iP + n)2k j^^ W + n + 2k) j 



(13.2-6) 



This implies for fixed k & IN and for large values of n the following order estimate: 

Sji S 



Proof: First, we observe that S^\j3, Sn-,iOn), eq. (8.2-7), is invariant under translation according 
to eq. (3.1-4). This implies that the magnitude of the transformation error and its dependence 

upon k and n can be analyzed by estimating the magnitude of S^\/3, Sn — s, w„). The starting 
point of our analysis is eq. (8.2-6) which is rewritten in the following way: 



(13.2-8) 
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In the numerator in eq. (13.2-8) («„ — s)/ujn is replaced by the factorial series (13.2-4) yielding 

k—1 oo 

= A' g + „ + + A' g (,^„:;i,)^.^, . (13.2-10) 

Next, we derive from eq. (8.4-10) the following two relationships: 

A''{a + n)m ={-!)'' i-m)k {a + n + k)m-k, (13.2-11) 
A'^ [1/(6 + nU = (-1)^= {m)k/ib + n)k+m ■ (13.2-12) 

If these two relationships are used in eq. (13.2-10), we find that the first sum vanishes since it 
is a polynomial of degree A; — 1 in n and we obtain for the numerator in eq. (13.2-8): 

k{P + n)k-i {sn -s) _ r(/3 + n + k-l) ^ Ck+j U + l)fc 



uJn T{l3 + n + 2k) ^ (/3 + n + 2k)j ' K ■ - ) 



With the help of eq. (2.4-8) we obtain for the denominator in eq. (13.2-8): 

^k iP + n)k-i ^ ^ ^_^y (k\ {P + n + j)k-r 

According to (S-1) the elements of ^ujn^ strictly alternate in sign. This gives us immediately 
the following estimate: 

\{(3 + n)k-i/cOn\ < |A^{(/3 + n)fc_i/aj„}l. (13.2-15) 

Combination of cqs. (13.3-8), (13.2-13) and (13.2-15) gives eq. (13.2-6). The order estimate 
(13.2-7) follows from the fact that according to eq. (13.2-4) 

(s„ - s)/u;„ = Co [1 + O(n-i)] , n ^ oo , (13.2-16) 

and that (/? + n)2k = 0{'n?^) as n — > oo. This proves theorem 13-5. 

Since the denominator sum (13.2-14), which consists of A: + 1 terms, is estimated by a single 
term according to eq. (13.2-15), the error estimate (13.2-6) is quite conservative. 

It is a typical feature of the error estimate (13.2-6) and also of some analogous error estimates 
for other sequence transformations, which will be derived later in this section, that the error 
estimate is directly proportional to a;„. Consequently, no distinction between convergent and 
divergent sequences \sn\ of partial sums has to be made. It also follows from the error estimate 
(13.2-6) that S^''\f3,Sn,ujji), cq. (8.2-7), is able to sum a divergent scries satisfying (S-0) - (S-2) 
on a horizontal path if the coefficients Cj of the factorial series (13.2-4) do not grow too fast in 
magnitude as j — > oo. 

The next theorem, which can be proved in essentially the same way as theorem 13-5, shows 
that our error analysis is able to distinguish between the sequence transformation sj^\l3,Sn,0Jn)j 
eq. (8.2-7), and its mild generalization S^J{(3,Sn,uJn), eq. (8.2-8), with £>1. 
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Theorem 13-6: Let us assume that the sequences {[sn]} and {[wn]} satisfy (S-0), (S-1), and 



E 

j=0 



dj 



(13.2-17) 



and that the sequence transformation sj^^ {f3, SnjiOn); eg. (8.2-8), with £ > 1 is used for the 
transformation of Then we obtain for fixed k,£ E IN with k > £ + 1 and for all n G Wq 

the following estimate for the error term: 



< 



UJr, 



dk-i+j (j + l)fc 



(/3 + n + £)2k-e ^ {(3 + n + 2k) j 



(13.2-18) 



This implies for fixed k,£ E IN with k > £ + 1 and for large values of n the following order estimate: 



Sr. - S 



(13.2-19) 



If we compare eqs. (13.2-4) and (13.2-17), it seems that in theorems 13-5 and 13-6 the existence 
of two different factorial series expansions for the ratio (s„ — s)/u)n are assumed. However, the 
factorial series (13.2-4) and (13.2-17) are not independent. In Nielsen's book it is shown how a 
factorial series of the type of eq. (13.2-4) can be transformed into a factorial series of the type of 
eq. (13.2-17) (see pp. 252 - 253 of rcf. [77]). 

Theorems 13-5 and 13-6 indicate that sj^\p, Sn,uJn), eq. (8.2-7), should normally be more 

efficient than its generalization sj^^ {(3, Sn,oJn), eq. (8.2-8), with £ > 1. 

In the following theorem, the efficiency of Drummond's sequence transformation P^"'*(s„,a;„), 
eq. (9.5-4), is analyzed. 

Theorem 13-7: Let us assume that the sequences {[sn]| and satisfy (S-0) - (S-2) and that 

Drummond's sequence transformation 'D^\sn, Oi>n) > eq. (9.5-4), is used for the transformation of 
{[sn]}- Then we obtain for fixed k E IN and for all n G JZVq tie following estimate for the error term: 



< 



UJr, 



Cj + l (j + 1) 



(/3 + n)fc+i {P + n + k + l)j 



(13.2-20) 



This implies for fixed k E IN and for large values of n the following order estimate: 



0{n ^ ^) , n -> cxD. 



Sn S 



(13.2-21) 



This theorem, which can be proved in exactly the same way as theorem 13-5, indicates that in 
particular for larger values of k Drummond's sequence transformation p["-*(s„,a;„), eq. (9.5-4), 
should be significantly less powerful than S^\p, SnjO^n), eq. (8.2-7), or its mild generalization 

45(/?,s„,w„), eq. (8.2-8), with £ > 1. 

It would be interesting to do the same kind of error analysis also for the sequence transformation 
A4^^\'y , Sn, oJn) , eq. (9.2-6), and its mild generalization A4^^l{'y, Sn,0Jn), eq. (9.2-7). However, if 
we would try to estimate the error term of this transformation for arbitrary sequences {[s„]} and 
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^LOn^ satisfying (S-0) - (S-2) we would in general end up with very complicated formulas which 
would contribute little to our understanding. This is due to the fact that for arbitrary P and 7 
we would have to use Leibniz' theorem for finite differences (see p. 35 of ref. [72]), 

A'^ [f{n)9{n)] = (^) [A^' /(n)] [A'^'^gin)] . (13.2-22) 

Much more revealing and enlightening is, however, the following observation: 
Theorem 13-8: Assume that 7 = /3 + — 2 holds. Then, 

M'i'\j,Sn,LOn) = (A ^n, O^n) . (13.2-23) 

Proof: If we use the following relationship for Pochhammer symbols (see eq. (1.5) on p. 239 of 
ref. [104]), 

(a - m)m = i-ir (1 - a)m , (13.2-24) 

we obtain 

(-7-n)fc_i = (-l)'=-i(n + 7-fe + 2)fc_i. (13.2-25) 
If we insert this relationship into eq. (9.2-6) and use j = P + k — 2, we obtain eq. (8.2-7). 

Theorem 13-8 does not imply that the two strings Mj^\'j, Sn,ujn) and Sj"'\(3 , Sn, oJn) with 
< j < k arc identical if 7 = (3 + k — 2 holds. Only the last elements of the two strings are 

guaranteed to be identical, but not the others. 

In the case of Levin's sequence transformation >C^"''' (/?, s„, a;„), eq. (7.1-7), an analysis of the 
magnitude of the error term as in theorem 13-5 would again be very complicated and would lead 
to lengthy and messy expressions. This is due to the fact that Levin's sequence transformation is 
constructed on the basis of the model sequence (7.1-1), which is merely a truncation of the inverse 
power series (13.2-5) after k terms, and that in the calculus of finite differences Pochhammer 
symbols and not powers are the most simple functions. However, at least some order estimates 
can be obtained relatively easily in the case of the Levin transformation. 

Theorem 13-9: Let us assume that the sequences {[sn]} and {[a;„]} satisfy (S-0), (S-1), and eq. (13.2-5) 

and that Levin's sequence transformation C^^\p, Sn,i^n), cq. (7.1-7), is used for the transformation 
of {[s„]}. Then we obtain for large values of n and for fixed k E IN the following order estimate: 



(")/ 

Oin-^"), n^oo. (13.2-26) 



Sf), S 



Proof: Obviously, i2^"'''(/3, s„, a;„) is invariant under translation according to eq. (3.1-4). This 
implies that the magnitude of the error term and its dependence upon k and n can be analyzed by 
estimating the magnitude of C^^\f5,Sn — s,ujn)- The starting point of our analysis is eq. (7.1-6) 
which is rewritten in the following way: 

(/3, - s,un) = ^k^^p + ^Y-./^^-^ ■ (13-2-27) 
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In the numerator in eq. (13.2-27) (s„ — s)/ujn is replaced by the power series (13.2-5) yielding 

k—l oo 

= A'^ 5: 4(/3 + n)'^-- + ^ . (13.2-29) 

The first sum on the right-hand side of eq. (13.2-29) is annihilated by A'^ since it is a polynomial 
of degree A; — 1 in n. The large n behaviour of the second sum can be estimated with the help of 
the relationship 

^m^-a ^ Q(^-a-m)^ ^>q^ (13.2-30) 



to give 



^k {P + nf ^{sn-s) ^ (132.31) 



Since the remainder estimates {[wn]} are strictly alternating in sign according to (S-1), we obtain 
the following estimate for the denominator in eq. (13.2-27), 

\{(5 + nf-^/u:n\ < |A'={(/3 + nf-^M\ . (13.2-32) 

If we combine eqs. (13.2-27), (13.2-31), and (13.2-32) and take into account that {l3 + n)''~^ = 
0(n^~^) as n — > oo, we sec that theorem 13-9 is correct. 

In the following theorem, which can be proved in essentially the same way as theorem 13-9, an 
order estimate for Levin's generalized sequence transformation >C^"^^(/?, s„,u;„), eq. (7.1-8), with 
£ > 1 is derived. 

Theorem 13-10: Let us assume that the sequences {[s„]} and {[w^]} satisfy (S-0), (S-1 ), and eq. (13.2-5) 

and that Levin's generalized sequence transformation C^^j (/?, Sn, w^), eq. (7.1-8), with £ > 1 is used 
for the transformation of {[s„]}. Then we obtain for fixed k,£ E IN with k > i -\- 1 and for large 
values of n the following order estimate: 

— ■ = 0(n ), n^oo. (13.2-33) 



A comparison of the order estimates (13.2-7), (13.2-19), (13.2-26), and (13.2-33) shows that 
Levin's sequence transformation C^^\(3,Sn,^n), eq. (7.1-7), should be roughly comparable 
with sj^\p,Sn,u}n), eq. (8.2-7), and that for fixed £ > 1 Levin's generalized transformation 
C^^j{P,Sn,Oi>n), eq. (7.1-8), should be roughly comparable with sj^j{P,Sn,Oi>n), eq. (8.2-8). In ad- 
dition, a comparison with the order estimate (13.2-21) shows that these sequence transformations 
should all be significantly more powerful than Drummond's sequence transformation T)^^ (s„, a;„), 
eq. (9.5-4). A more detailed comparison cannot be made here since this would require additional 
knowledge about the sequence and the remainder estimates 

The error analysis of this section is restricted to convergent or divergent sequences {[sn]} with 
strictly alternating remainder estimates {[o-'n]}- This restriction is essential because otherwise the 
denominator sums of the pertaining sequence transformations cannot be estimated by a single 
term as it was for instance done in eqs. (13.2-15) and (13.2-32). If we want to analyze the 
transformation of sequences with nonalternating remainders, additional assumptions about the 
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behaviour of the remainders have to be made. For instance, in the case of logarithmic convergence 
we could assume something like 



because then the denominator of eq. (13.2-8) could be computed with the help of eq. (8.4-10) and 
we would obtain an explicit expression for the transformation error S^\p, s„ — s, u;„). With the 
help of similar assumptions Sidi [56,105] could derive various error estimates for Levin's sequence 

transformation >C^"^(/3, s„,a;„), eq. (7.1-7), in convergence acceleration and summation processes. 

13.3. Summation of the Euler series 

Fade approximants are generally accepted to be valuable numerical tools for the treatment of 
scientific problems. Therefore, it is certainly interesting to compare Fade approximants with the 
other sequence transformations of this report. 

Unfortunately, the theoretical error estimates for the Fade summation of a Stieltjes series, which 
can be found in the literature, are not directly comparable with the error estimates of section 13.2, 
in which the error is always directly proportional to the remainder estimate uin- For instance, in 
the articles by Allen, Chui, Madych, Narcowich, and Smith [101], and by Karlsson and Sydow 
[102] the summation error is expressed in terms of polynomials which are orthogonal with respect 
to the measure ^(t) in the Stieltjes integral (13.1-1). 

Consequently, we first would have to derive something like theorem 13-5 for Fade approximants 
before we could compare Fade approximants and the sequence transformations C^j^\(3, Sn,iOn), 



eq. (7.1-7), 5f^(/3,s„,cj„), eq. (8.2-7), Sn,iOn), eq. (9.2-6), and ^(s„, w„), eq. (9.5- 



M^^{'y,Sn,u}n), eq. (9.2-7), with respect to their ability of summing divergent Stieltjes series or 
accelerating the convergence of some alternating series. Unfortunately, no such theorem could be 
derived which treats the Fade summation of an arbitrary Stieltjes series. 

However, there is a notable exception. In the case of the Euler integral, eq. (1.1-6), and its 
associated asymptotic series, the so-called Euler series, eq. (1.1-7), Sidi [84] could show that their 
Fade approximants can be expressed in closed form via Drummond's sequence transformation 
LJn), eq. (9.5-4), with cOn = a„+i. Sidi's proof is based upon the well-known fact that 
Wynn's e algorithm, eq. (4.2-1), which according to eq. (4.2-10) is able to compute the Fade 
approximants [n + k/k], is exact for the model sequence (4.1-3). In the case of the Euler series, 
eq. (1.1-7), we have 





(13.2-34) 



4), and their mild generalizations >C^"^ (/3, s„, u;„), eq. (7.1-8), 5^" (/3, s„, u;„), eq. (8.2-8), and 



n 




(13.3-1) 



(13.3-2) 



If we insert these relationships into the model sequence (4.1-3), we obtain 



fe-i 




(13.3-3) 
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This model sequence for the Pade approximants [n + k/k] of the Euler series can be rewritten 
in the following way: 

_ '^"^ 

, ^1 = y Cj {-ly {n + 2)j . (13.3-4) 

(-l)"+^(n + l)!z'*+i 

The sum on the right-hand side of eq. (13.3-4) is a polynomial of degree k—1 in n. Consequently, 
it can be annihilated by the difference operator A'^. Hence, it follows from eq. (9.5-2) that the 
Pade approximants [n + k/k] for the Euler series can be expressed in closed form in terms of 
Drummond's sequence transformation, eq. (9.5-4), 

[n + k/k] = e^^^ = V'^\sn,an+i), k,nelNo. (13.3-5) 

From this relationship we may conclude that in the case of the Euler series Drummond's 
sequence transformation is much more efficient than Wynn's e algorithm. If the diagonal Pade 
approximant [n/n], which according to eq. (4.1-8) is a ratio of two polynomials Pn{z) and qn{z) 
of degree n in z, is computed with the help of Wynn's e algorithm as eg^j, the partial sums 
sq,si, . . . , S2n of the Euler series will be needed. If the same diagonal Pade approximant [n/n] is 

computed as 'Dn\so, ai), then according to eq. (9.5-4) only the partial sums sq, si, . . . , s^+i will 
be needed. Consequently, in the case of the Euler series, Drummond's sequence transformation 
is approximately twice as efficient as Wynn's e algorithm. 

How can this behaviour be explained? If Drummond's sequence transformation is applied to 
a sequence of partial sums of the Euler series, then we find that Vn\so,ai) is the ratio of two 
polynomials Pn{z) and qn{z) of degree n in z. However, it follows from eq. (9.5-4) that the 
2ra -|- 2 coefficients of the two polynomials are not all independent. In fact, these two polynomials 
Pn{z) and qn{z) are completely determined by the n + 2 terms ao, oi, • • • , On+i- If the same 
ratio Pn(,z) / Qniz) is computed via Wynn's e algorithm, it is implicitly assumed that the 2n -|- 2 
coefficients of the two polynomials are independent apart from a common normalization condition. 
This implies that Wynn's e algorithm needs 2n + l independent conditions - in this case the 2n+l 
partial sums sq, si, . . . , S2n ^ for the construction of the ratio pn{z)/qn{z). 

Actually, it is a typical feature of all sequence transformation T"^ ^(•Snj ojn) of the type of eq. 
(12.2-2) that the coefficients of the numerator and denominator sums are not independent. 

It is a natural idea to try to apply theorem 13-7, which gives an error estimate for Drummond's 
sequence transformation, also for of the Pade summation of the Euler series. Assumptions (S-0) 
and (S-1) are obviously satisfied. However, it is not clear whether and how a sequence {[a;„]} of 
remainder estimates can be found such that assumption (S-2), which requires that (s„ — s)/u>n 
can be represented as a factorial series according to eq. (13.2-4), is valid. No explicit proof for the 
existence of such a factorial series could be found in the case of the Euler series, if the remainder 
estimates were chosen according to 

= {-lf+^{n + l)\z'^+^, nGlNo- (13.3-6) 

Consequently, it can only be investigated numerically whether the error analysis of theorem 
13-7 provides an adequate description of the Pade summation of the Euler series. 
A close relative of the Euler integral, eq. (1.1-6), is the so-called exponential integral 



E,{z) = —dx. 

J z 



(13.3-7) 
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By means of some elementary operations we find: 

If we compare this relationship with eq. (1.1-6) and also use cq. (1.1-7), we see that the 
associated Stieltjes series of the integral in eq. (13.3-8) is the Euler series with argument 1/z, 

oo 

ze^Ei{z) ~ ^ (-l)"'m!z-'" = 2Fo{l,l; -1/z) , z^oo. (13.3-9) 

m=0 

The radius of convergence of the hypergeometric series 2-^0 on the right-hand side of eq. (13.3-9) 
is zero, i.e., the series diverges quite rapidly for all finite values of z. Since reliable programs for 
the exponential integral Ei{z) with z G IR+ are available, eq. (13.3-9) is well suited to test the 
ability of a sequence transformation of summing even wildly divergent scries. In this report, the 
exponential integral Ei(z) will be computed with the help of the routine S13AAF of the NAG 
FORTRAN library [106]. This function computes an approximation for the exponential integral 
in DOUBLE PRECISION (15 - 16 decimal digits) using appropriate Chebyshev expansions. 



Table 13-1 

Summation of the asymptotic series 2Fo{l,l;—l/z) = ze^ Ei{z) fov z = 3 



n 


partial sum Sn 
eq. (13.1-10) 


,(n-2ln/2l) 
^[n/21 

eq. (5.1-15) 


eq. (9.5-4) 


(n-2ln/2l) 
2ln/2l 

eq. (4.2-1) 


10 


0.4831550069 


X 


1002 


0.78625130019479 


0.78625125348502 


0.78626367674141 


11 


-0.1770160037 


X 


1003 


0.78625114835779 


0.78625123263883 


0.78624220653206 


12 


0.7243100137 


X 


IqOS 


0.78625122394910 


0.78625122525386 


0.78625447790898 


13 


-0.3181436062 


X 


1004 


0.78625121766831 


0.78625122252501 


0.78624881508686 


14 


0.1504537896 


X 


1005 


0.78625122089403 


0.78625122147819 


0.78625215335611 


15 


-0.7608869613 


X 


1005 


0.78625122063943 


0.78625122106292 


0.78625052018310 


16 


0.4099597043 


X 


1006 


0.78625122077179 


0.78625122089311 


0.78625150842397 


17 


-0.2344314565 


X 


1007 


0.78625122076057 


0.78625122082175 


0.78625100153477 


18 


0.1418133105 


X 


1008 


0.78625122076626 


0.78625122079099 


0.78625131522011 


19 


-0.9048109119 


X 


1008 


0.78625122076568 


0.78625122077742 


0.78625114787954 


20 


0.6072683904 


X 


1009 


0.78625122076597 


0.78625122077131 


0.78625125348502 


21 


-0.4276977981 


X 


lOlO 


0.78625122076594 


0.78625122076850 


0.78625119524201 


22 


0.3154082874 


X 


lO^i 


0.78625122076595 


0.78625122076718 


0.78625123263883 


23 


-0.2430623561 


X 


10^2 


0.78625122076596 


0.78625122076656 


0.78625121141456 


24 


0.1953763123 


X 


10^3 


0.78625122076595 


0.78625122076626 


0.78625122525386 


25 


-0.1635311587 


X 


10^4 


0.78625122076596 


0.78625122076611 


0.78625121720071 


26 


0.1423065021 


X 


10^5 


0.78625122076596 


0.78625122076603 


0.78625122252501 


27 


-0.1285630059 


X 


10^6 


0.78625122076596 


0.78625122076600 


0.78625121935772 


28 


0.1204177785 


X 


10^7 


0.78625122076596 


0.78625122076598 


0.78625122147819 


29 


-0.1167898319 


X 


10^8 


0.78625122076596 


0.78625122076597 


0.78625122019177 


30 


0.1171526266 


X 


1019 


0.78625122076596 


0.78625122076596 


0.78625122106292 


NAG fuuctiou S13AAF 




0.78625122070591 


0.78G2512207G591 


0.78G2512207G591 
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In table 13-1 the effect of Aitken's iterated process, eq. (5.1-15), of Drummond's sequence 
transformation, eq. (9.5-4), and of Wynn's e algorithm, eq. (4.2-1), on the partial sums 

n 

Sn = ^ (-l)'"m! z-"', nGiNo (13.3-10) 

m=0 

of the divergent scries 2^0 in cq. (13.3-9) with z = 3 is compared. In Drummond's sequence 
transformation, eq. (9.5-4), the remainder estimates are chosen according to eq. (13.1-16) which 
in this case means 

= an+1 = (-l)"+i(n + l)!z-"-S nGlNo. (13.3-11) 

The partial sums and the three different transforms in table 13-1 were computed in QUADRU- 
PLE PRECISION (31 - 32 decimal digits). When these computations were repeated in DOUBLE 
PRECISION (15 - 16 digits) in order to study the numerical stability of the pertaining numerical 
processes, it turned out that the two computations agreed at least up to 12 decimal digits. 

In all cases, the approximants were chosen in such a way that the information, which is contained 
in the finite string .so;*!) • • • > Sn of partial sums, is exploited optimally. This means that in the 
case of Aitken's iterated process, eq. (5.1-15), the approximants were chosen according to eq. 
(5.2-6), and in the case of Wynn's e algorithm, eq. (4.2-1), they were chosen according to eq. 
(4.3-6). 

A comparison of these three sequence transformations is quite interesting. Aitken's iterated A^ 
process and Wynn's e algorithm are closely related since they are both generalizations of Aitken's 
A^ process, eq. (5.1-4), and one would like to know which one of these two generalizations fares 
better. In addition, since the series (13.3-9) is the Eiiler series with argument l/z, the validity 
of eq. (13.3-5) can be checked numerically by comparing the results for Wynn's e algorithm and 
Drummond's sequence transformation. 

The clear winner in table 13-1 is Aitken's iterated A^ process which produces 14 decimal 
digits after n = 23 (there is strong independent evidence that the last digit produced by the 
NAG function S13AAF in table 13-1 is incorrect and that Aitken's iterated A^ process and 
Drummond's sequence transformation produce the correct result). It is followed by Drummond's 
sequence transformation, which reaches an accuracy of 14 decimal digits after n = 30, and the 
clear loser is Wynn's e algorithm. 

The results in table 13-1 show that eq. (13.3-5) is obviously valid in the case of the divergent 
series 2-?^o(l) 1; ~^/^) because we find 

P(0)(.0,ai) = 6^. (13.3-12) 

Since V^q{so, ai) is able to produce an accuracy of 14 decimal digits, it follows from eq. (13.3- 
12) that Wynn's e algorithm will need the partial sums so,si, . . . , sqq of the asymptotic series in 
eq. (13.3-9) to produce the same accuracy. 

In table 13-2 the same divergent series 2-^0 in eq- (13.3-9) with z = Sis summed by the sequence 
transformations dn\f3,so), eq. (7.3-9), and Sn\/3,so), eq. (8.4-4), with /3 = 1 and A^°''(7, sq), 
eq. (9.4-4), with 7 = 17. These three sequence transformations use the same remainder estimate 

(13.3-11) as vl^\so,al) in table 13-1. 

Table 13-2 was also produced in QUADRUPLE PRECISION. When this computation was 
repeated in DOUBLE PRECISION, it turned out that in the last two columns all 14 digits 
agreed. Only in the case of the Levin transformation dn\/3,so), eq. (7.3-9), it occasionally 
happened that the last digit disagreed. Thus, numerical instabilities are no problem here. 
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Table 13-2 

Summation of the asymptotic series 2 i^o(l) 1; — 1/2:) = ze^ Ei{z) for z = 3 



n 


partial sum s„ 
eq. (13.1-10) 


1(0)/^ \ 
eq. (7.3-9) 


eq. (8.4-4) 


Ar(17, so) 
eq. (9.4-4) 


3 


0.6666666667 


X 


10°o 


0.78709677419355 


0.78672985781991 


0.78633660627852 


4 


0.9629629630 


X 


10°° 


0.78607714016933 


0.78622197922362 


0.78625813355638 


5 


0.4691358025 


X 


10°o 


0.78628225839245 


0.78625036724446 


0.78625167667778 


6 


u. 14100 1 yuizo 


X 


iU 


0.78624675493384 


0.78625141640628 


0.78625123654802 


7 


-0.8477366255 


X 


iqOO 


0.78625162955159 


0.78625123162756 


0.78625121997903 


8 


0.5297668038 


X 


io°i 


0.78625123599599 


0.78625121903376 


0.78625122068020 


9 


-0.1313854595 


X 


10°2 


0.78625120523222 


0.78625122051031 


0.78625122077447 


10 


0.4831550069 


X 


10°2 


0.78625122396512 


0.78625122077239 


0.78625122076641 


11 


-0.1770160037 


X 


1003 


0.78625122056582 


0.78625122077131 


0.78625122076576 


12 


0.7243100137 


X 


1003 


0.78625122068924 


0.78625122076646 


0.78625122076598 


13 


-0.3181436062 


X 


1004 


0.78625122079175 


0.78625122076590 


0.78625122076596 


14 


0.1504537896 


X 


1005 


0.78625122076354 


0.78625122076593 


0.78625122076595 


15 


-0.7608869613 


X 


1005 


0.78625122076528 


0.78625122076595 


0.78625122076596 


16 


0.4099597043 


X 


IOO6 


0.78625122076622 


0.78625122076596 


0.78625122076596 


17 


-0.2344314565 


X 


10°7 


0.78625122076593 


0.78625122076596 


0.78625122076596 


18 


0.1418133105 


X 


1008 


0.78625122076595 


0.78625122076596 


0.78625122076596 


NAG function S13AAF 




0.78625122076594 


0.78625122076594 


0.78625122076594 



A comparison of the results in tables 13-1 and 13-2 confirms the error analysis in section 
13.2, which indicates that Drummond's sequence transfornicttioii X^r (^^^^ LJn), eq. (9.5-4), should 
be significantly less powerful than the sequence transformations C^^^\/3, Sn,i^n), eq. (7.1-7), 
sj^\p, Sn,(^n), eq. (8.2-7), and A^^"^ (7, s„, ci;„), eq. (9.2-6), if the same remainder estimates 
{[wn]} are used. Even dn\p, sq), which is somewhat weaker than the other two transformations in 
table 13-2, is clearly more powerful than the transformations in table 13-1, and both A^''''(7,so) 

and Sn\p,so) are approximately twice as efficient as X>n°^(so, oi)- This observation is at least 
qualitatively in agreement with the order estimates (13.2-7) and (13.2-21). 

In view of its slow convergence a Fade summation of the divergent series 2-^0 in eq. (13.3-9) does 
not seem feasible if its argument is significantly smaller than 2; = 3 as it was chosen in table 13-1. 
If, however, variants of the sequence transformations C^^\/3, Sn,0On), eq. (7.1-7), S^\^,Sn-,0Jn)-, 

eq. (8.2-7), and ^^^.""^(7, s„,a;„), eq. (9.2-6), are used, the summation of the divergent series in 

eq. (13.3-9) can be done even for relatively small arguments. Table 13-3 shows that the sequence 

transformations dn\(3,SQ), eq. (7.3-9), and 5n\l3,SQ), eq. (8.4-4), with (5 = 1 and /s!:a\'^ , sq) , 
eq. (9.4-4), with 7 = 29 are able to sum the divergent series 2-Pb in eq. (13.3-9) with an accuracy 
of 14 decimal digits even if the argument of the series is as small as z = 1/2. 

In the case of table 13-3 it is essential to use QUADRUPLE PRECISION. In DOUBLE 
PRECISION, a heavy loss of significant digits occurs. The best results in DOUBLE PRECISION 
are obtained by An\l-iSQ) for n = 20 (10 decimal digits). For larger values of n, the accuracy 
of the results deteriorates rapidly due to numerical instabilities, leading to nonsensical results for 
the Levin transformation d^Q{(3,so) and to only 3 digits accuracy for S^{(3,so) and A3q^(7, sq). 

If the other variants of the sequence transformations £[."^(/3, s„,a;„), eq. (7.1-7), sj^\l3,Sn,0Jn)j 
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Table 13-3 

Summation of the asymptotic series 2 i^o(l) 1; — 1/2:) = ze^ Ei{z) for z = 1/2 



n 


partial sum s„ 
eq. (13.1-10) 


7(0/1 \ 

eq. (7.3-9) 


eq. (8.4-4) 


Ar(29,so) 
eq. (9.4-4) 


15 


-0.4147067254 


X 


10^^ 


0.46145531715043 


0.46145531958535 


0.46145595366489 


16 


0.1329725286 


X 


10^9 


0.46145530923846 


0.46145531701552 


0.46145551453546 


17 


-0.4529093729 


X 


1q20 


0.46145531613431 


0.46145531625982 


0.46145536941468 


18 


u.iooouozyio 


X 


iU 


0.46145531735759 


0.46145531613493 


0.46145532757622 


19 


-0.6214401349 


X 


1q23 


0.46145531627646 


0.46145531616450 


0.46145531778365 


20 


0.2488938643 


X 


1025 


0.46145531605612 


0.46145531620445 


0.46145531622965 


21 


-0.1046565329 


X 


1027 


0.46145531622971 


0.46145531622787 


0.46145531618769 


22 


0.4609744216 


X 


1028 


0.46145531627375 


0.46145531623807 


0.46145531623838 


23 


-0.2122526902 


X 


1030 


0.46145531624564 


0.46145531624153 


0.46145531624494 


24 


0.1019714416 


X 


1032 


0.46145531623631 


0.46145531624231 


0.46145531624191 


25 


-0.5102726985 


X 


1033 


0.46145531624080 


0.46145531624227 


0.46145531624156 


26 


0.2655415912 


X 


1035 


0.46145531624283 


0.46145531624210 


0.46145531624194 


27 


-0.1434925159 


X 


10^7 


0.46145531624214 


0.46145531624197 


0.46145531624189 


28 


0.8040791666 


X 


1038 


0.46145531624170 


0.46145531624191 


0.46145531624184 


29 


-0.4666476909 


X 


1040 


0.46145531624180 


0.46145531624188 


0.46145531624188 


30 


0.2801466126 


X 


10^2 


0.46145531624189 


0.46145531624187 


0.46145531624187 


NAG function S13AAF 




0.46145531624187 


0.46145531624187 


0.46145531624187 



eq. (8.2-7), and M-j. (7,s„,u;„), eq. (9.2-6), which are based upon the remainder estimates 
(7.3-4), (7.3-6), (7.3-10), and (9.4-1), arc used for the summation of the divergent scries 2-P0 in 
eq. (13.3-9), it turns out that these transformations arc roughly comparable with dn\p, sq), 
6n\p,so), or An\-f,so), which were used in tables 13-2 and 13-3. 

The other sequence transformations of this report do not sum the divergent series 2-^0 in 
eq. (13.3-9) as efficiently as the transformations mentioned above. For instance, Brezinski's 
'd algorithm, cq. (10.1-9), or other transformations, which are based upon the i9 algorithm, as 

for instance J'l'^\ eq. (10.3-6), B^^\ eq. (11.1-5), and eq. (11.1-12), all rank between 

Aitken's iterated A2 algorithm, eq. (5.1-15), and Drummond's sequence transformation, eq. (9.5- 
4), with respect to their ability of summing the divergent series in eq. (13.3-9). The sequence 

transformations A^"\ eq. (11.2-1), cr^\ eq. (11.2-2), and fJ'^i^\ eq. (11.2-3), sum the divergent 
series 2-^0 in ^q. (13.3-9) slightly less efficient than Drummond's sequence transformation. 

It is a remarkable fact that compared with dn\p,so), eq. (7.3-9), 6n\p,so), eq. (8.4-4), or 
, So), eq. (9.4-4), which were used in tables 13-2 and 13-3, the Pade summation of the 
divergent series 2-^0 in eq. (13.3-9) is hopelessly inefficient, even if the Fade approximants are 
computed via Drummond's sequence transformation according to eq. (13.3-5) and not via Wynn's 
e algorithm. 

How can this inferiority of Fade approximants be explained? It was remarked earlier, that the 
Fade approximants [n + k/k] for the Euler series can be constructed on the basis of the model 
sequence (13.3-5). The remainder r„ of this model sequence is of order 0{z^^^^n^^^) as n — > 00. 
However, it follows from theorem 13-2 that the remainder integral Rn{z) of the Euler series (1.1- 
7) with z G 1R+ is rigorously bounded by (n -|- l)\z'^'^^ which is only of order 0{z'^'^^n'^^^) as 
n ^ 00. Hence, we see that the remainder of the model sequence (13.3-3) for Fade approximants 
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[n + k/k] yields unrealistically large estimates in the case of a wildly divergent series such as 
the Euler series. Consequently, it is to be expected that in the case of such a wildly divergent 
series Pade approximants will be less efficient than sequence transformations which use tighter 
remainder estimates as for instance suitable variants of >C^"'*(/3, s„,a;„), eq. (7.1-7), «S^"^(/3, s„,a;„), 

eq. (8.2-7), and ^^["^(7, s„,c<;„), eq. (9.2-6). 

There is considerable numerical evidence that the inferiority of Pade approximants in summa- 
tion processes is not restricted to the Euler series. For instance, the numerical tests performed by 
Smith and Ford [29,30], who also considered the summation of several alternating divergent series, 
showed that Levin's u transformation, eq. (7.3-5), is significantly more powerful than Wynn's e 
algorithm. 

The inferiority of Pade approximants in summation processes also becomes quite obvious in the 
case of the following class of auxiliary functions, 

F^{z) = [ M^me-^^'du, mGlNo, z G IR+ . (13.3-13) 
Jo 

These auxiliary functions F^{z) are of considerable importance in molecular ab initio calcula- 
tions with Gaussian-type basis functions since the nuclear attraction and interelectronic repulsion 
integrals are ultimately expressed in terms of these functions. In molecular calculations these 
auxiliary functions have to be computed over a wide range of parameters m and arguments z so 
frequently that it amounts to a significant part of the whole integral evaluation time. In the case 
of larger arguments z, it is recommendable to compute this auxiliary function via its asymptotic 
expansion, 

- ^^^^^ - ^ 2^0(1, 1/2 - m; -1/z) , z ^ 00 . (13.3-14) 

In ref. [63] it was shown that Levin's d transformation, eq. (7.3-9), sums this divergent series 
much more efficiently than Wynn's e algorithm. Later, in ref. [107] the effect of the sequence 

transformations u^^^\l3,Sn), eq. (7.3-5), y^^\p,Sn), eq. (8.4-2), and y^f"-* (7, s„), eq. (9.4-2), on 
the divergent scries 2-^0 in eq. (13.3-14) was compared. Similarly as in the case of the divergent 
series 2-F0 in eq. (13.3-9) it was found that Levin's u transformation is slightly less efficient than 
the analogous new sequence transformations y^\p,Sn) and Y^"'\'y,Sn)- 



13.4. A Stieltjes series with a finite radius of convergence 

Let us consider the following integral representation for the logarithm which is defined for all 
z belonging to the cut complex plane which is cut along — 00 < 2; < — 1, 

The integral in eq. (13.4-1) is a Stieltjes integral as the one in eq. (13.1-1). To see this we only 
have to set ijj{t) = t for < t < 1 and V'(i) = 1 for 1 < t < 00 in eq. (13.1-1). The moments /x^ 
of this positive measure ip{t) are given by 

/ t'^di/jU) = / rdt = -, mGlNo. (13.4-2) 

Jo Jo rn + l 
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If we use these moments fim in eq. (13.1-3), we obtain the following power series for the 
logarithm which is by construction a Stieltjes series: 



ln(l + z) 



oo 

E 

m=0 



m + 1 



^2i^i(i,i;2, 



(13.4-3) 



The power series in eq. (13.4-3) converges absolutely for all z G C with \z\ < 1, for z = 1 the 
series converges conditionally, and all for z G C with > 1 the series diverges. However, as long 
as the argument 2; G C does not lie on the cut, the divergent series can at least in principle be 
summed. 

It may be interesting to note that the infinite series (13.4-3) for ln(2) occurs also in solid state 
physics since it gives the Madelung constant of a 1-dimensional lattice of oppositely charged ions 
(see pp. 74 - 75 of ref. [108]). According to Killingbeck the infinite series (13.4-3) occurs also if 
correlation effects in atoms are treated via perturbation theory (see p. 969 of ref. [109]). 

In the last section, it was demonstrated both theoretically and numerically that the sequence 
transformations £^"^(/?, s„,a;n), eq. (7.1-7), s'f^ {f3,Sn,(^n)-, eq. (8.2-7), and M^^\'^,Sn-,0Jn), 
eq. (9.2-6), sum the wildly divergent series 2-^0 in oq. (13.3-9), which is essentially the Euler 
series, significantly more efficiently than Pade approximants. In addition, some arguments were 
presented which indicate that this inferiority of Pade approximants is not restricted to the Euler 
series (1.1-7) and will occur also in the case of other wildly divergent series. For 1 < z < 00, the 
sequence of partial sums of the Stieltjes series in eq. (13.4-3), 



E 

m=0 



m + 1 



n G INo, 



(13.4-4) 



obviously diverges but not as wildly as the partial sums of the divergent series ^Fq in eq. 
(13.3-9). Consequently, it should be interesting to investigate whether the striking superiority 



of the sequence transformations >cl"^ (/?, s. 



and A^l"'^(7, s„,a;„), over Pade 



approximants is also observed in the case of the Stieltjes series (13.4-3). 

In this context it would of course be helpful to have some theoretical summation error estimates. 
In the case of the sequence transformations /^^"^(Z?, s„,a;n), eq. (7.1-7), <S^"'^(/3, s„,a;„), eq. (8.2-7), 

and A4^^\'y, Sn,u;n), eq. (9.2-6), this poses no problems. If the argument z of the Stieltjes scries 
in eq. (13.4-3) is positive, the error analysis of section 13-2 can be used since the remainders of 
the power series are then strictly alternating. 

In the case of Pade approximants the error analysis of section 13-2 cannot be applied because 
only the Pade approximants of the Euler series, eq. (1.1-7), can be computed via Drummond's 
sequence transformation. In Wimp's book [23] the effect of Wynn's e algorithm, eq. (4.2-2), on 
the following model sequence is studied. The elements of this model sequence are defined by 
Poincare-type asymptotic expansions in inverse powers of n, 



~ s + yn^Y^ Cj/n^ , Co 7^0, 



n 



00 . 



(13.4-5) 



j=0 



A sequence of the type of eq. (13.4-5) should be a reasonably good model for the behaviour of 
the partial sums Sn of the series (13.4-3) as n ^ 00. The sequence (13.4-5) obviously converges 
linearly if |A| < 1 and it diverges if |A| > 1. Assuming A 7^ 1 and ?? 7^ 0, 1, . . . , fc — 1 in eq. (13.4-5), 
Wimp obtained for fixed G IN the following order estimate (see p. 127 of ref. [23]): 



— S 



Co A"+2'= 71^^-2^ k\ (-??)fe 



(A-1) 



2k 



l + O 



n 



n 



00 . 



(13.4-6) 
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Since Sji — s X^n as n — > oo, we obtain from eq. (13.4-6) the following order estimate: 

(n) _ 

^2^—^ ^ 0(n-2^') , n^oo. (13.4-7) 

Sji s 

The error estimate (13.4-6) shows quite clearly that for |A| < 1 Wynn's e algorithm accelerates 
the convergence of the linearly convergent sequence. It also follows from the error estimate (13.4- 
6) that the limit s can be determined more easily if A is negative which is well in agreement with 
experience. 



Table 13-4 

Summation of the divergent series Z2Fi{l, 1; 2; —z) = ln(l + z) for z = 5 



n 


partial sum s„ 
eq. (13.4-4) 






(n-2[n/2l) 
^2[n/2l 

eq. (4.2-1) 




eq. (7.3-7) 




rf (l,so) 
eq. (8.4-3) 


10 


0, 


.3639603183 


X 


10°^ 


1 


.79198007997771 


1, 


.79175951159974 


1, 


.79175959220168 


11 


-0, 


,1670544890 


X 


1008 


1 


.79159768463775 


1, 


.79175946864530 


1, 


.79175949178480 


12 


0, 


.7719479148 


X 


1008 


1 


.79179758764032 


1, 


.79175946794412 


1, 


.79175947333854 


13 


-0, 


.3587706103 


X 


1009 


1 


.79173348919423 


1, 


.79175946933559 


1, 


.79175946997338 


14 


0, 


.1675734598 


X 


lOlo 


1 


.79176609278102 


1, 


.79175946926071 


1, 


.79175946936268 


15 


-0, 


.7861008566 


X 


lOlo 


1 


.79175520193427 


1, 


.79175946922241 


1, 


.79175946925230 


16 


0, 


.3701778279 


X 


10^1 


1 


.79176062438322 


1, 


.79175946922743 


1, 


.79175946923241 


17 


-0, 


.1749098431 


X 


10^2 


1 


.79175875744767 


1, 


.79175946922828 


1, 


.79175946922884 


18 


0, 


.8289578584 


X 


1012 


1 


.79175967119854 


1, 


.79175946922806 


1, 


.79175946922819 


19 


-0, 


.3939413724 


X 


1013 


1 


.79175934919749 


1, 


.79175946922805 


1, 


.79175946922808 


20 


0, 


.1876711762 


X 


1014 


1 


.79175950460547 


1, 


.79175946922806 


1, 


.79175946922806 


21 


-0, 


.8960496379 


X 


1014 


1 


.79175944882296 


1, 


.79175946922806 


1, 


.79175946922806 


22 


0, 


.4286962951 


X 


1015 


1 


.79175947543322 


1, 


.79175946922805 


1, 


.79175946922806 


23 


-0, 


.2054830571 


X 


1016 


1 


.79175946573795 


1, 


.79175946922805 


1, 


.79175946922806 


24 


0, 


.9866098385 


X 


1016 


1 


.79175947031756 


1, 


.79175946922806 


1, 


.79175946922806 


25 


-0, 


.4744606005 


X 


1017 


1 


.79175946862827 


1, 


.79175946922806 


1, 


.79175946922806 



FORTRAN function QLOG 1.79175946922806 1.79175946922806 1.79175946922806 



However, if we compare the order estimate (13.4-7) with the order estimates (13.2-7) and (13.2- 

26) for sj^\p,Sn,u}n), eq. (8.2-7), and C^^\p, Sn,LOn), eq. (7.1-7), respectively, we find that 
Wynn's e algorithm should be significantly less efficient than the other two sequence transfor- 

(n) 

mations mentioned above. This follows from the fact that for the computation of , which 
according to eq. (13.4-7) gives an order estimate of order 0{n~'^^), 2k + 1 sequence ele- 
ments Sn, Sn+i, ■ ■ ■ , Sn+2k will be needed, whereas for the computation of sj^\/3, Sn,(^n)j and 
iOn), which also give an error estimate of order 0(n 2^)^ only A; -|- 1 sequence elements 
Sn, Sn+1, Sn+k will be needed. 

In table 13-4 the effect of the sequence transformations t^j^\/3,Sn), eq. (7.3-7), t^\P, Sn), eq. 
(8.4-3), with P = 1 and Wynn's e algorithm, eq. (4.2-1), on the partial sums of the divergent 
Stieltjes series in eq. (13.4-3) with z = 5 are compared. 

The results in table 13-4 are another striking example for the inferiority of Fade approximants 
in summation processes. The results also indicate that our conclusions concerning the efficiency 
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of Pade approximants in summation processes, which were based upon a comparison of the order 
estimates in theorems 13-5 and 13-9 and in eq. (13.4-6), should at least be qualitatively correct. 

Table 13-4 was produced in QUADRUPLE PRECISION. When the same computation was 
repeated in DOUBLE PRECISION, some loss of accuracy was observed. The best results were 
produced by tn\l, so) and Tn\l, sq) for n between 15 and 18 (approximately 11 decimal digits). 
For larger values of n the accuracy deteriorates. 



Table 13-5 

Acceleration of the conditionally convergent series 2:2-^1(1, 1; 2; —z) = ln(l + z) ioi z = 1 



n 




partial sum s„ 
eq. (^io.4-4j 




(n-2|In/2l) 
^2ln/2l 

eq. {fi.z-L) 




AO),-, \ 
eq. \(.6-t) 




(0)/-, X 

eq. (^0.4-oj 


3 


0, 


.58333333333333 


0, 


.69047619047619 


0, 


.69313725490196 


0, 


.69321533923304 


4 


0, 


.78333333333333 


0, 


.69333333333333 


0, 


.69314393939394 


0, 


.69314971751412 


5 


0, 


.61666666666667 


0, 


.69308943089431 


0, 


.69314740192831 


0, 


.69314726571364 


6 


0, 


.75952380952381 


0, 


.69315245478036 


0, 


.69314717779003 


0, 


.69314718328808 


7 


0, 


.63452380952381 


0, 


.69314574314574 


0, 


.69314718001500 


0, 


.69314718064517 


8 


0, 


.74563492063492 


0, 


.69314733235438 


0, 


.69314718060123 


0, 


.69314718056257 


9 


0, 


.64563492063492 


0, 


.69314714248772 


0, 


.69314718055924 


0, 


.69314718056003 


10 


0, 


.73654401154401 





.69314718496213 


0, 


.69314718055985 


0, 


.69314718055995 


11 


0, 


.65321067821068 


0, 


.69314717951778 


0, 


.69314718055995 


0, 


.69314718055995 


12 


0, 


.73013375513376 


0, 


.69314718068816 


0, 


.69314718055995 


0, 


.69314718055995 


13 


0, 


.65870518370518 


0, 


.69314718053085 


0, 


.69314718055995 


0, 


.69314718055995 


14 


0, 


.72537185037185 


0, 


.69314718056369 


0, 


.69314718055995 


0, 


.69314718055995 


15 


0, 


.66287185037185 


0, 


.69314718055912 


0, 


.69314718055995 


0, 


.69314718055995 


16 


0, 


.72169537978362 


0, 


.69314718056005 


0, 


.69314718055995 


0, 


.69314718055995 


17 


0, 


.66613982422806 


0, 


.69314718055992 


0, 


.69314718055995 


0, 


.69314718055995 


18 


0, 


.71877140317543 


0, 


.69314718055995 


0, 


.69314718055995 


0, 


.69314718055995 


FORTRAN function QLOG 


0.69314718055995 


0.69314718055995 


0.69314718055995 



The Stieltjes series (13.4-3) is not only suited to test the efficiency of a sequence transformation 
in summation processes. A very popular test case, which is frequently found in the literature, 
is the conditionally convergent series (13.4-3) for ln(2) which converges quite slowly. According 
to Bender and Orszag (see p. 372 of ref. [2]) about 7000 terms of the series in eq. (13.4-3) 
with z = 1 will be needed to compute ln(2) with a relative accuracy of 0.01 percent. The same 
sequence transformations as in table 13-4 accelerate the convergence of the series for ln(2) also in 
table 13-5. This time, the e algorithm is comparatively successful since it only needs the partial 
sums (13.3-4) up to n = 18 to produce an accuracy of 14 decimal digits. However, the other two 
sequence transformations in table 13-5 are still significantly more powerful. 

Table 13-5 was again produced in QUADRUPLE PRECISION. When this computation was 
repeated in DOUBLE PRECISION, no loss of accuracy was observed. 

The potential of the Stieltjes series (13.4-3) for ln(l -|- z) to test the performance of sequence 
transformations is not yet exhausted. If the argument z of the power series satisfies — 1 < z < 0, 
all of its terms have the same sign. The convergence of this series will become quite bad if 
z approaches —1 because for 2; = — 1 it becomes the series (1.1-2) for (^(1) which diverges. 
Consequently, it should be interesting to find out whether and how well the convergence of the 
Stieltjes series (13.4-3) can be accelerated if its argument z is close to —1. 
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In this context, it would again be helpful to have some theoretical error estimates. In the 
case of Pade approximants this poses no problems. If we assume that the elements of the model 
sequence (13.4-5) is still a good model for the behaviour of the partial sums (13.4-4) as n ^ oo, 
we may conclude from eq. (13.4-6) that Wynn's e algorithm will accelerate the convergence of 
the sequence (13.4-5). 

In the case of the sequence transformations >C^"^(/3, Sn,a;n), eq. (7.1-7), S^\p, Sn,ujn), eq. (8.2- 

7), andXi"^(7, ujn), eq. (9.2-6), the situation is more complicated since the error analysis of 
section 13-2, which rests upon the assumption that the remainder estimates strictly alternate in 
sign, cannot be applied here. Consequently, we have to find estimates of the type of eq. (13.4-6) 
for the other sequence transformations mentioned above. 

Theorem 13-11: Let us assume that the elements of the sequence {[s„]} satisfy 

Sn = s + X"- [cq + 0{n-'^)] , cq ^ , X^0,1, n^oo, (13.4-8) 
that the elements of the sequence of remainder estimates {[a;„]} can be chosen in such a way that 

co^ = X^n^ [do + 0{n-^)], do ^ , n ^ oo , (13.4-9) 
and that the ratio (s„ — s)/un can for all n G INq be expressed as a factorial series, 



If the sequence transformation S^\p, Sn,C0n), eq. (8.2-7), is used for the transformation of -{[sn]}, 
we obtain for fixed k G IN the following order estimate: 



0{n-^^), n^oo. (13.4-11) 



iP^^nj^n) ~ ^ _ rtl -2fc 



5*7, S 



Proof: We can proceed as in theorem 13-5, i.e., the starting point for the proof of theorem 13-11 
is eq. (13.2-8). Since eqs. (13.2-4) and (13.4-10) are identical we find that the numerator of this 
expression is also given by eq. (13.2-13) which is obviously of order 0{n~^~^) as n — > oo. 

In order to obtain an estimate for the denominator A'^[(/3 -|- n)fe_i/a;„] we use (see eq. (41) on 
p. 21 of ref. [23]) 

A*^[z"n°^] ~ z"(z- 1)^=71°, z^l, n^oo. (13.4-12) 
This relationship gives us the following asymptotic estimate for the denominator in eq. (13.2-8): 

A'=[(/3 + n)fe-i/a;„] ~ [1 - Xf X-''-'' n''-'^-\ n ^ oo . (13.4-13) 

If we combine the expressions for the numerator and the denominator and take into account 
that s„ — s ~ X^nf as n — > oo, we obtain eq. (13.4-11). 

In the next theorem, which can be proved in essentially the same way as theorem 13-11, it is 
shown that Levin's sequence transformation £^'*'*(/3, s„, a;„), eq. (7.1-7), also leads to an error 
estimate of order 0{n^'^^). 

Theorem 13-12: Let us assume that the elements of the sequence {[sn]} satisfy 

= s + [co + 0{n-^)] , cq ^ , X^0,1, n^oo, (13.4-14) 
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that the elements of the sequence of remainder estimates {[o^n]} can be chosen in such a way that 

Un = X"" n'^ [do + 0{n-^)] , do 7^0, n ^ oo , (13.4-15) 

and that the ratio (s„ — s)/un can for all n G Wq be expressed as a power series of the following 
type, 

= y ,o ' ^■ , /3 e JR+ . (13.4-16) 

'^n j^^ (/3 + n)^' ^ + ^ ^ 

If tiie sequence transformation C^^\(5,Sn,ijJn), eq. (7.1-7), is used for the transformation of {[sn]}, 
we obtain for fixed k E IN the following order estimate: 

Cf\l5,sn,u,n) - s ^ oin-^'^), n^oo. (13.4-17) 



The error estimate (13.4-17) for Levin's sequence transformation has in principle already been 
derived by Sidi (see cq. (3.14) on p. 840 of rcf. [105]). 

In the same way, it can be proved that for fixed A; € IN and for large values of n the sequence 
transformations C^^]^{(3, Sn,oJn), eq. (7.1-8), and sj^''^{P, Sn,LOn), eq. (8.2-8), with ^ G IN lead to 

error estimates of order 0{n^~'^^) and that Drummond's sequence transformation p['^'*(s„,a;„), 
eq. (9.5-4), leads to an error estimate of order 0{n~^~^). 

On the basis of these order estimates it is to be expected that in the case of negative arguments 
z the different variants of ^(f3,Sji, 

uon), eq. (7.1-7), and 5^"^(/3, s„,a;n), eq. (8.2-7), should 
accelerate the convergence of the Stieltjes series in eq. (13.4-3) more efficiently than the analogous 
variants of the generalized transformations >C^"j(/3, s„, a;„), eq. (7.1-8), and S^J{fi,Sn,LJn), eq. 
(8.2-8), with I >1. Also, Drummond's sequence transformation, eq. (9.5-4), should be roughly 
as efficient as Wynn's e algorithm, eq. (4.2-1). 

In table 13-6 the convergence of the absolutely convergent Stieltjes series (13.4-3) with z = —0.9 
is accelerated by the same sequence transformations as in tables 13-4 and 13-5. The inferiority of 
Wynn's e algorithm is again evident. 

Table 13-6 was produced in QUADRUPLE PRECISION. When the same computation was 
repeated in DOUBLE PRECISION, a heavy loss of accuracy was observed. No transformation 
was able to produce an accuracy of more than 8 decimal digits. These 8 digits were produced by 
Tn\'^, So) for n = 17, by tn'^ {\, sq) for n = 21, and by Wynn's e algorithm for n = 30. For larger 
values of n the accuracy deteriorated again. However, it seems that Wynn's e algorithm is not as 
much affected by numerical instabilities as the other two sequence transformations in table 13-6. 

More extensive numerical tests showed that in the case of the convergent or divergent Stieltjes 
series in eq. (13.4-3) 5j^"'^(/3,s„,a;„), eq. (8.2-7), had a slight plus over £j,"'^(/3, s„, a;„), eq. (7.1- 
7). A comparison of the numerous variants of the sequence transformations s„, a;„) and 

S^\(5,Sn,u}n) showed that they difi'er in their ability of summing or accelerating the Stieltjes 
series in eq. (13.4-3). Those variants, which are based upon the remainder estimates (7.3-4) 
and (7.3-8), are approximately as efficient as t^^\j3,Sn), eq. (7.3-7), and T^^\l3,Sn), eq. (7.3-7). 
However, v^^\l3,Sn), eq. (7.3-11), and ip^^\j3,Sn), eq. (8.4-5), which are both based upon the 
remainder estimate (7.3-10), were significantly less efficient. Also, M.^^\''i,Sn,^n), eq. (9.2-6), 
and its variants were somewhat less efficient than the analogous variants of C^^\j3,Sn,ijJn) and 
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Table 13-6 

Acceleration of the absolutely convergent series 2:2-^1(1, 1; 2; —z) = ln(l + z) for 2; = —0.9 



n 


partial sum Sn 
eq. (13.4-4) 


(n-2[n/2l) 
^2[n/2l 

eq. (4.2-1) 


tn (l,So) 

eq. (7.3-7) 


T^n (i,Soj 

eq. (8.4-3) 


15 


-2.23201245730299 


-2.30249119271252 


-2.30258308878949 


-2.30258507564758 


16 


-2.24182256418514 


-2.30253886165435 


-2.30258429564850 


-2.30258508829481 


17 


-2.25016115503498 


-2.30255980521704 


-2.30258477584394 


-2.30258509172157 


18 


-2.25727090091747 


-2.30257257511841 


-2.30258496686622 


-2.30258509264961 


19 


-2.26334973364700 


-2.30257828055989 


-2.30258504284117 


-2.30258509290084 


20 


-2.26856016170088 


-2.30258170574611 


-2.30258507305389 


-2.30258509296883 


21 


-2.27303639307444 


-2.30258325724815 


-2.30258508506691 


-2.30258509298723 


22 


-2.27688984443081 


—2 30258417685642 


—2 30258508984292 


—2 30258509299220 


23 


-2.28021344622568 


-2.30258459820761 


-2.30258509174154 


-2.30258509299355 


24 


-2.28308503817645 


-2.30258484529651 


-2.30258509249623 


-2.30258509299391 


25 


-2.28557006967230 


-2.30258495961133 


-2.30258509279620 


-2.30258509299401 


26 


-2.28772376363538 


-2.30258502604192 


-2.30258509291542 


-2.30258509299404 


27 


-2.28959286232476 


-2.30258505703207 


-2.30258509296280 


-2.30258509299404 


28 


-2.29121704463416 


-2.30258507490093 


-2.30258509298163 


-2.30258509299404 


29 


-2.29263008324333 


-2.30258508329701 


-2.30258509298911 


-2.30258509299405 


30 


-2.29386079429003 


-2.30258508810542 


-2.30258509299209 


-2.30258509299405 


FORTRAN function QLOG 


-2.30258509299405 


-2.30258509299405 


-2.30258509299405 



Almost as efficient as the sequence transformations mentioned above were , (10-3-6), 

and eq. (11.1-12), followed by Brezinski's f? algorithm, eq. (10.1-9). Next came Aitken's 
iterated process, eq. (5.1-15), which was again more efficient than Wynn's e algorithm, eq. 

(4.2-1). The transformations eq. (11.1-5), A^.^^ eq. (11.2-1), a'j^\ eq. (11.2-2), and IJ,^^'\ eq. 
(11.2-3), were weaker than the e algorithm. 

Of all transformations tested Drummond's sequence transformation, eq. (9.5-4), was least ef- 
ficient. It was able to sum or accelerate the Stieltjes series (13.4-3) moderately well for positive 
arguments z, i.e., as long as the terms of the power series for ln(l -|- z) had alternating signs. 
However, it failed completely if the argument z approached —1. For instance, for z = —0.9 Drum- 
mond's sequence transformation produced a sequence of transforms Vn\sQ,ai) which rapidly 
diverged with increasing n. This example shows that asymptotic order estimates - although un- 
deniably quite helpful for the classification of sequence transformations - do not necessarily tell 
the whole truth about the capability of a sequence transformation. 
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14. The acceleration of logarithmic convergence 

14.1. Properties of logarithmically convergent sequences and series 

It is tempting to believe that the most formidable task for a nonlinear sequence transformation 
is the summation of a wildly divergent scries such as the Eulcr series, eq. (1.1-7), and that 
convergence acceleration should not be overly troublesome. In the case of alternating series 
or sequences with strictly alternating remainders, this is indeed normally true. However, it will 
become clear later in this section that the acceleration of the convergence of a monotonic sequence 
or a series with terms, that all have the same sign, can be a more formidable computational 
problem than the summation of an alternating divergent series. 

The numerical examples presented in sections 13.3 and 13.4 showed that several sequence 
transformations are able to sum efficiently divergent series with alternating terms. In addition, it 
was shown that it is frequently possible to sum alternating divergent scries with an accuracy that 
is close to or identical with machine accuracy. Particularly efficient and also remarkably reliable 

(n) 

were variants of Levin's sequence transformation (/?, s„, eq. (7.1-7), and partly even more 

so variants of the new sequence transformations sj^!''\l3, Sn,u}n)^ eq. (8.2-7), and Al[,"^ (7, s„, u;„), 
eq. (9.2-6). 

The situation is much less satisfactory if logarithmic convergence has to be accelerated. Many 
series with positive terms are known which converge so slowly that the evaluation of such a series 
by successively adding up the terms would be hopeless. In such a case, the use of a convergence 
acceleration method is indispensable. However, there is a considerable amount of theoretical 
and numerical evidence which indicates that convergence acceleration methods are generally less 
efficient and also more susceptible to rounding errors in the case of series with positive terms than 
in the case of alternating series. Consequently, it is often easier to sum an alternating divergent 
series, even if it diverges quite wildly, than to accelerate the convergence of a slowly convergent 
series with terms that all have the same sign. 

A good example of a very slowly convergent series with positive terms is the series (1.1-2) for the 
Riemann zeta function. It is well known that this series converges for all z G C with Re{z) > 1. 
However, it follows from eqs. (7.3-12) and (7.3-14) that the remainder r„ of the series (1.1-2), 
which is defined by 

00 

Tn = ("^+1)"'. (14-1-1) 

m=n+l 

is of order 0(n^^^) as n 00. Consequently, the computation of (,{z) with the help of the series 
(1.1-2) would only be feasible if Re{z) is relatively large. But even then, the use of convergence 
acceleration techniques would be recommendable. 

In order to make this section, in which the acceleration of logarithmic convergence by means 
of nonlinear sequence transformations will be treated, more self contained, first some properties of 
logarithmically convergent sequences and series are reviewed. A sequence -{[sn]}) which converges 
to some limit s, is said to converge logarithmically if 

lim f!i±l^ = 1. (14.1-2) 

n— >oo Sn — S 

This definition of logarithmic convergence is inconvenient since it involves the limit s of the 
sequence {[s„]} which is normally not known. Thus, it would be advantageous to have an 
alternative criterion for logarithmic convergence which only involves the differences As„. Such 
an equivalent criterion can be formulated if it is assumed that the elements of the sequence {[sn]} 
are partial sums of an infinite series with real terms that all have the same sign. Then, Clark, 
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Gray, and Adams could show (see theorem 2 on p. 26 of ref. [35]) that the sequence of partial 
sums converges logarithmically according to eq. (14.1-2) if the following condition holds: 

lim ^ = lim = 1 . (14.1-3) 

n— ►oo Uji n— >oo As„_i 

Eq. (14.1-3) implies tliat for larger indices n the terms a„ of a logaritlimically convergent series 
differ only slightly. This fact is not only responsible for the often prohibitively slow convergence 
of logarithmically convergent series but also affects convergence acceleration processes in a very 
unpleasant way. 

A sequence transformation can only beat the conventional process of successively adding up the 
terms of a series if it does not only use the numerical values of the terms. It also has to extract 
from the terms of the series some additional information about the behaviour of the partial sums 

Sn as n increases. 

All sequence transformations of this report retrieve and utilize this additional information by 
computing rational expressions of weighted differences of partial sums. In the case of alternating 
series the computation of these weighted differences normally does not lead to a serious loss of 
significant digits. If, however, the terms a„ of a series all have the same sign and do not differ 
much in magnitude, this additional information, which has to be retrieved, is hidden somewhere in 
the later digits. Consequently, in the case of logarithmic convergence the computation of weighted 
differences is likely to lead to a cancellation of significant digits and ultimately, i.e., in the case of 
large transformation orders, completely nonsensical results are to be expected. This explains why 
rounding errors are more or less inevitable if logarithmic convergence is accelerated and why the 
acceleration or summation of alternating series is frequently remarkably stable. A good discussion 
of these stability problems can be found in an article by Longman [58]. 

A theoretical analysis of the acceleration of logarithmic convergence is also far from simple. 
For instance, it would certainly be quite helpful if an analogue of Germain-Bonne's theory of the 
acceleration of linear convergence [33] could be developed because then a decision based on some 
theoretical criteria could be made whether a given sequence transformation is able to accelerate 
logarithmic convergence or not. In the case of linear convergence this question can be decided on 
the basis of theorems 12-4 and 12-14. It only has to be shown that the sequence transformation 
under consideration is exact for a sequence which apart from a shift of indices consists of the partial 
sums of the geometric series, and it is guaranteed that linear convergence will be accelerated. 

Smith and Ford had speculated whether it might be possible to develop an analogue of Germain- 
Bonne's theory also in the case of logarithmic convergence, i.e., whether some special sequence 
could be found such that the exactness of a sequence transformation for this sequence would 
imply that all logarithmically convergent sequences will be accelerated. They also had presented 
some potential candidates which in their opinion might possibly be suited to serve as this special 
sequence (see p. 238 of ref. [29]). In the meantime, this question has been answered by Delahaye 
and Germain-Bonne [110], but unfortunately the answer is negative. Delahaye and Germain- 
Bonne [110] showed that no algorithm exists which would be able to accelerate the convergence 
of every logarithmically convergent sequence. Consequently, a general theory in the spirit of 
Germain-Bonne's theory, which would cover the acceleration of all logarithmically convergent 
sequences, cannot exist. Such an analogue of Germain-Bonn's theory can exist at most for suitably 
restricted subsets of the set of logarithmically convergent sequences. But it seems that even this 
has not yet been accomplished so far. 
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14.2. Exactness results and error estimates 

As mentioned in the last section, a theoretical analysis of the acceleration of logarithmic 
convergence is far from simple. Particularly hard is the analysis of the acceleration properties of 
those sequence transformations which are defined by a complicated nonlinear recursive scheme 
as for instance Brezinski's i? algorithm, eq. (10.1-9). In those cases, apart from the defining 
recursive scheme only very little else is normally known. However, at least for Levin's sequence 
transformation C^^\p, s„,a;„), eq. (7.1-7), some exactness results and asymptotic error estimates 
can be derived quite easily if suitable model sequences are considered. 

Similar exactness results and error estimates as for Levin's sequence transformation can also 
be derived for the sequence transformations 5^, ''(/3, s^j, LJn)) cq. (8.2-7), and Mi'\j, 
eq. (9.2-6). However, they will not be considered here. The reason is that numerical tests 
showed that those variants of these sequence transformations, which should be able to accelerate 
logarithmic convergence, are significantly less efficient than the analogous variants of Levin's 
sequence transformation. For the moment, no completely satisfactory explanation can be given 
why these otherwise very powerful sequence transformations perform so weakly in the case of 
logarithmic convergence. It is at least conceivable that in the case of logarithmically convergent 
sequences inverse powers of n are better suited for a description of the n-dependence of the ratios 
(sn — s)/ujn than Pochhammer symbols, which are the basis of the sequence transformations 
sj^^\p, Sn,u)n), eq. (8.2-7), and A1^"''(7, 5^,0;^)) eq. (9.2-6). However, this is only speculation. 

The explicit expressions of Levin's u transformation, eq. (7.3-5), and t transformation, eq. 
(7.3-7), are very similar. Also, with respect to the acceleration of linear convergence or the 
summation of alternating divergent series these two sequence transformations have virtually 
identical properties. However, in the literature on convergence acceleration it is always emphasized 
that Levin's u transformation is one of the best accelerators of logarithmic convergence, whereas 
Levin's t transformation completely fails to accelerate logarithmic convergence. In view of the 
otherwise close similarity of these two sequence transformations this different behaviour with 
respect to the acceleration of logarithmic convergence is certainly quite puzzling. It will now be 
shown that the different properties of Levin's u and t transformation can be understood on the 
basis of the different exactness properties of these two sequence transformations. 

Quite common in practical applications are logarithmically convergent sequences {[sn]} with 
remainders -{[r„]| that are of order 0(n~°) with a G IR+ as n ^ 00. Hence, for large values of n 
the elements of such a logarithmically convergent sequence can be characterized in the following 
way: 

s„ = s + n""[c + 0(n"^)], aGlR+, n^oo. (14.2-1) 

The explicit expressions for n^"'-'(/3, s„), eq. (7.3-5), and t^f^\j3,Sn), eq. (7.3-7), contain the 
terms a„ of the series which is to be transformed. If these two transformations are to be applied 
to sequences of the type of eq. (14.2-1), the terms a„ in the explicit expressions have to be 
replaced by the differences As„_i. If we compute these differences and apply some simplifying 
assumptions, which are permitted if n is large, we see that sequences of the type of eq. (14.2-1) 
satisfy: 

{sn - s) / Asn-i = 0(n) , 00. (14.2-2) 

This relationship is quite typical of logarithmically convergent sequences of the type of eq. 
(14.2-1). Also, eq. (14.2-2) is essentially identical with the remainder estimate (7.3-4), which is 
the basis of Levin's u transformation. 

In the following theorem the exactness properties of Levin's u and t transformation for a special 
class of logarithmically convergent model sequences are analyzed. Model sequences belonging to 
this special class have the same behaviour as n — > 00 as the dominant term of sequences of 
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the type of eq. (14.2-1). Consequently, the fohowing theorem makes it plausible why Levin's 
u transformation accelerates the convergence of sequences of the type of eq. (14.2-1), and why 
Levin's t transformation fails to accelerate the convergence of these sequences. 

Theorem 14-1: Assume that a sequence transformation T^^\sn) is defined in the following way: 



-{n), s _ [Pfc_i(n) s„/A 

Sn— 1 1 

A*^ [Pk-i{n)/Asn-i] 



i^n) = rn T' k,nelNo. (14.2-3) 



(n) is for sufEcicntly large values of k a polynomial of degree < k — 1 in n. Obviously T^^^^ (sn) 
is defined as long as does not annihilate Pk-i{n) / Asn-i, i.e., as long as Pk-i{n) / Asn-i is not 
a polynomial of degree < k — 1 in n. 

Let us assume that the sequence {[sn]}; which converges to some limit s, belongs to the domain of the 
sequence transformation T^^^ and that its elements satisfy for all n G Wq 

{sn-s)/Asn-i = jn + 5, j,deR, 77^0. (14.2-4) 

If for sufEciently large values of k the degree of P^-i (n) is exactly k — 1, T^^^ (s„) does not accelerate 

the convergence of {[snlfi and if Pfe_i(n) is a polynomial of degree < k — 2 in n, T^"'\sn) is exact 
for {[s„]}. 

Proof: Since 1k^\sn) is obviously invariant under translation in the sense of eq. (3.1-4), we can 
write 

Next, the ratio («„ — ■s)/As„_i in eq. (14.2-5) is replaced by 7n -|- 5 according to eq. (14.2-4). 
This yields 

Let us now assume that k is large enough such that Pk-i{n) is a polynomial of degree < k — 1 
in n. If the degree of Pfe_i(n) in eq. (14.2-6) is exactly A; — 1, the product {'jn + S)Pk-i{n) is 
a polynomial of degree k in n. Consequently, this product will not be annihilated by A*^ and 
'Tk^\sn) will not accelerate {[sn]}- If, however, Pk-i{n) is of degree < /c — 2 in n, the product 
(7n -|- 5)Pfc_i(n) is a polynomial of degree < A; — 1 in n. Consequently, this product will be 
annihilated by A'^ and T^"'\sn) is exact for {[sn]}- This proves theorem 14-1. 

In the case of Levin's u transformation, eq. (7.3-5), the polynomial Pk-i{n) is given by 
{P + n)^~^, i.e., it is a polynomial of degree — 2 in n. Consequently, u^^\f5, s„) will be exact 
for sequences {[sn]} satisfying eq. (14.2-4). In the case of Levin's t transformation, eq. (7.3-7), 
the polynomial Pk-i{n) is given by {(3 + n)^~^, i.e., it is a polynomial of degree fc — 1 in n. This 
implies that t^j^\l3, ,s„) will not accelerate the convergence of a sequence satisfying eq. (14.2-4). It 
also follows from theorem 14-1 that for sufficiently large values of fc Levin's generalized sequence 
transformation >C^"j(/9, s„, a;„), eq. (7.1-8), with i > 2 and Un = As„_i is also exact for every 
sequence {[sn]} satisfying eq. (14.2-4). 

A simple example of a logarithmically convergent sequence, which for all n G INq satisfies eq. 
(14.2-4), would be 

s^ = s + ^^^, a,6elR+, a<b. (14.2-7) 
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In sections 13.2 and 13.4 error estimates for the summation of divergent Stieltjes series and 
the acceleration of the convergence of Stieltjes series by means of sequence transformations as 
for instance s„, eq. (7.1-7), or5f)(/3,s„ eq. (8.2-7), were derived. It could be 

shown that the application of these sequence transformations to the partial sums of convergent 
or divergent Stieltjes series lead to asymptotic error estimates which were of order 0(n~^'^) as 
n ^ oo. In the next theorem a similar asymptotic error analysis is done for a large class of 
logarithmically convergent sequences. 

Theorem 14-2: Let us assume that the elements of the sequence {[sn]}) which converges logarithmically 
to some limit s, satisfy 

Sn = s + n~'^ [bo + 0{n~^)] , bo ^ , a e IR+ , n^oo. (14.2-8) 

Let us also assume that the elements of a sequence of remainder estimates {[wn]} can be chosen in 
such a way that 

LOn = n''"'[do + 0{n'^)], do , n ^ oo , (14.2-9) 

and that the ratio (s^ — s)/(a;„) can for all n € Wq be expanded in a power series of the following 
type, 

oo 

£^ = y , /3 G JR+ . (14.2-10) 

f^o il^ + ^y 

If the uJn), eq. (7.1-7), is used for the acceleration of the 

convergence of {[s„]}, we obtain for fixed k & IN and for n —>■ oo the following order estimate: 



Proof: We can proceed as in theorem 13-9, i.e., the starting point for the proof of theorem 14-2 
is the representation of the transformation error d^^\(5,Sn — s,LOn) as in eq. (13.2-27). Since the 
series expansions (13.2-4) and (14.2-10) are structurally identical, we can conclude that according 
to eq. (13.2-31) the numerator of the transformation error is also of order 0{n~'^'~^) as n — > oo. 

In order to obtain an estimate for the denominator A^[{f3 + n)^~^ / ujn] wc take into account that 
according to eq. (14.2-9) the remainder estimate a;„ is of order 0(n~") as n — > oo. This implies 
that [P + nf-'^lujn is of order 0(n'=+'*-^) as n — > oo. Hence, with the help of eq. (13.2-30) we 
obtain the following order estimate for the denominator of the transformation error: 

A*^[(/3 + n)^-Vc^n] = 0(n"-^), n ^ oo . (14.2-12) 



If we combine this relationship with the expression for the numerator of the transformation error 
according to eq. (13.2-21), which is of order 0{n~^~^) as n ^ oo, we find that the transformation 

error C^^''\p,Sn — s,ujn) is of order 0(n~"~'') as ra — > oo. If we next divide the transformation 
error by s„ — s and use eq. (14.2-8), we obtain eq. (14.2-11) which proves theorem 14-2. 

An essentially identical result as theorem 14-2 was derived previously by Sidi (see theorem 
4.2 on p. 320 of ref. [56]). A comparison of the asymptotic order estimate (14.2-11) with the 
analogous order estimates (13.2-26) and (13.4-17) in theorems 13-9 and 13-12, respectively, which 
are all of order 0{n~'^^) as n — > oo, shows that the acceleration of logarithmic convergence is 
indeed a much more formidable task than the acceleration of Unear convergence, and it can be 
even harder than the summation of wildly divergent series. 
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In extensive numerical studies performed by Smith and Ford [29,30] it was demonstrated that 
Levin's u and v transformations, eqs. (7.3-5) and (7.3-11), respectively, are among the best 
accelerators for logarithmic convergence. Hence, we have to conclude that the relative inefficiency 
of Levin's sequence transformation according to theorem 14-2 is entirely due to the complicated 
nature of logarithmically convergent sequences and that it cannot be attributed to an intrinsic 
weakness of Levin's sequence transformation. 

The next theorem, which can be proved in the same way as theorem 14-2, shows that Levin's 
generalized sequence transformation >C^"j(/3, s„, u;„), eq. (7.1-8), with £ > 1, is also able to 
accelerate logarithmically convergent sequences of the type of eq. (14.2-8). However, with 
increasing ^ G INT the efficiency of the acceleration process deteriorates. 

Theorem 14-3: Let us assume that the sequences {[sn]} and {[wn]} are chosen as in theorem 14-2. It the 

sequence transformation uJn), eq. (7.1-8), is used for the acceleration of the convergence 

of we obtain for fixed k,i E IN with k > £ + 1 and for n ^ oo the following order estimate: 

Sji s 



(14.2-13) 



14.3. Some numerical test series 

Due to the lack of theoretical criteria, by means of which it can be decided whether a given 
sequence transformation is able to accelerate logarithmic convergence or not, numerical testing 
will be of particular importance. In the literature on convergence acceleration the partial sums 
of the series expansion (1.1-2) for C(2), 

oo 

C(2) = ^(m + l)-2 = n'/6, (14.3-1) 

m=0 

are frequently used to test the ability of a sequence transformation of accelerating logarithmic 
convergence. It follows from cqs. (7.3-12) and (7.3-14) that the remainders r„ of this scries are 
of order 0(n~^) as — > oo, i.e., the convergence of the sequence of partial sums of this series is 
prohibitively slow and the series for ^(2) indeed appears to be a good test problem for logarithmic 
convergence. However, the next theorem shows that it can happen that a sequence transformation 
is able to accelerate the convergence of a sequence if the remainders behave like an integral power 
of 1/n as n — > oo but fails to accelerate convergence if the remainders behave like a nonintegral 
power of 1/n. Consequently, the partial sums of the series (14.3-1) for ({2) are not suited to 
test the ability of a sequence transformation of accelerating the convergence of a large class of 
logarithmically convergent sequences. 

Theorem 14-4: Let us assume that the linear sequence transformation A^j^\(3, s„), cq. (7.3-20), which 
corresponds to the special case Xn = ^/{P + n) of the Richardson extrapolation scheme, eq. (6.1-5), 
is applied to the following logarithmically convergent model sequence: 

oo 

^" = ^ + + n)°'+j ' "^-^0, a,PeIR+, co^O. (14.3-2) 

If a is a positive integer, i.e., a = 1,2, . . ., we obtain for fixed k E IN and k > a and for large values 
of n the following asymptotic order estimate 

A'i'\p,sn)-s = 0(71-^=-^), (14.3-3) 
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which shows that {/3, Sn) accelerates the convergence of this sequence according to eq. (2.7-7) 
for sufEciently large values of k. 

If, however, a is not a positive integer, A^"^ s„) does not accelerate the convergence of the sequence 
(14.3-2). 

Proof: Obviously, a[,"'^(/?, eq. (7.3-20), is invariant with respect to translation according to 
eq. (3.1-4). Hence, with the help of eqs. (7.3-17) and (7.3-19) we can write: 

A«»)„,.„)-. = ^!M±f(£rL^. ,14.3-4) 

Let us now assume that a is a positive integer, i.e., a = m with m G IN, and that k > m. Then, 
with the help of eq. (14.3-2) we obtain for the numerator of the right-hand side of eq. (14.3-4): 

k—m oo 

A'^ [(/? + nf{sn - s)] = A'^Yl ""iW + nf-"^-' + ^'^ ^k-m+j+iW + ■ (14-3-5) 

The first sum on the right-hand side is a polynomial of degree k — m in n, i.e., it is annihilated 
by a''', and according to eq. (13.2-30) the second sum will produce a result which is of order 
0(n^^^^) as n ^ oo. This proves eq. (14.3-3). 

Let us now assume that a is not a positive integer. Then, with the help of eqs. (13.2-30) 
and (14.3-2) we obtain for the numerator of the right-hand side of eq. (14.3-4) the following 
asymptotic estimate 

oo 

Al'[{l3 + nf{sn-s)] = /SJ" Y Cj + nf-'^-^ = ©(n"") , n oo , (14.3-6) 

which proves the second part of theorem 14-4. 

Hence, if we want to use the Richardson extrapolation scheme, eq. (6.1-5), for the acceleration 
of the logarithmically convergent sequence (14.3-2) if a is not a positive integer, we cannot use 
the interpolation points Xn = + n) and we would at least have to find a different set of 
interpolation points There is considerable numerical evidence that the situation is quite 

analogous in the case of Wynn's p algorithm, eq. (6.2-2). The standard form of Wynn's p 
algorithm, eq. (6.2-4), corresponds to the choice Xn = P + n for the interpolation points. It 

is together with its iteration yvj^\ eq. (6.3-4), probably the best accelerator for the partial 
sums of the series (14.3-1) for C(2), but is apparently not able to accelerate the convergence of 
a sequence with remainders that behave like as n ^ oo. However, it will be shown later 

that the general form of Wynn's p algorithm, eq. (6.2-2), is able to accelerate the convergence 
of sequences with remainders r ^ ~ n as n — oo if the interpolation points {[xn]} are chosen 
according to x„ = (/3 + n)^/^ with (3 > 0. 

We shall sec later that for instance Brezinski's algorithm, eq. (10.1-9), or its iteration J'il^\ 
eq. (10.3-6), are able to accelerate the convergence of sequences, whose remainders behave like 

n~^/^ as n ^ oo. Consequently, and J'^"''' are more flexible and versatile than the Richardson 
extrapolation scheme or Wynn's p algorithm since these sequence transformations only work if 
appropriate interpolation points {[x„]} are used. 

This implies that because of theorem 14-4 the infinite series (14.3-1) for (^(2) is not suited to 
test the ability of a sequence transformation of accelerating logarithmic convergence. Instead, one 
should use test problems with remainders that behave like a nonintegral power of 1/n as n — >^ oo. 
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A simple idea would be to use the infinite series (1.1-2) for ({z) for nonintegral arguments and 
not for z = 2. However, only if z is an even positive integer, a simple explicit expression for ((z) 
is known (see p. 19 of ref. [34]). Therefore, the use of the infinite series (1.1-2) for ((z) with 
2; ^ IN as a test problem for logarithmic convergence would be somewhat inconvenient and the 
emphasis in this report will be on other test problems. 

Well suited for our purposes is the following series expansion (see p. 14 of ref. [Ill]): 

^^ (2m-l)!! 1 
^ - 2^ (2m)!! 4m + r ^^^""^ 

Here, A stands for the so-called lemniscate constant which can be expressed in terms of the 
complete elliptic integral K (see pp. 358 - 359 of ref. [34]), 



If we use the following expression for the ratio of two gamma functions which holds for — ^- 00 
(see p. 12 of ref. [34]), 

= z"-^[l + 0{z-')], |arg(z)| <7r, (14.3-9) 

we find that the terms of the series (14.3-7) behave like n~^/^ as n — >■ 00. Consequently, it follows 
from eqs. (7.3-12) and (7.3-14) that the remainders of this series behave like n~^/^ as n ^ 00. 

When Smith and Ford [29] investigated numerically the performance of sequence transforma- 
tions in convergence acceleration and summation processes, they used the series (14.3-7) for the 
lemniscate constant A to test the ability of a sequence transformation of accelerating logarithmic 
convergence. Smith and Ford observed that the standard version of Wynn's p algorithm, eq. 
(6.2-4), was not able to accelerate the convergence of this series (see p. 235 of ref. [29]). 

Another test problem, which is well suited for our purposes, is the following series expansion 
for 1/z in terms of the so-called reduced Bessel functions, 

00 

yz = J2 km-i/2{z) I [2"^ m!] , z G IR+ . (14.3-10) 

m=0 

This series expansion was derived and used in connection with explicit expressions for certain 
molecular multicenter integrals of exponentially declining basis functions (see eq. (6.5) of ref. 
[112]). In table I of ref. [64] it was shown that this series converges extremely slowly. For z = \ 
the infinite series (14.3-10) produced an accuracy of only three decimal digits after 1 000 000 
terms. 

The so-called reduced Bessel function ky{z) of real or complex order i/, which was introduced 
by Steinborn and Filter (see eqs. (3.1) and (3.2) of ref. [113]) as an exponentially declining basis 
function in electronic structure calculations, is defined by 

fc,(z) = (2/7r)i/2z'^X,(2). (14.3-11) 

Here, Kyi^z) is a modified Bessel function of the second kind (see p. 66 of ref. [34]). If the 
order v of the reduced Bessel function is half-integral and positive, 1/ = n -|- 1/2 with n G INq, a 
reduced Bessel function can be represented as an exponential multiplied by a terminating confluent 
hypergeometric series \F\ (see eq. (3.7) of ref. [114]), 

fcn+i/2(^) = 2'^(l/2)„e-^Fi(-n;-2n;22). (14.3-12) 
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The polynomial part of these reduced Bessel functions with half-integral orders v = n + 1/2 
with n G INq has also been investigated independently in the mathematical literature. There, the 
following notation is used (see p. 34 of ref. [115]): 

= e^^„+i/2(^) = 2"(l/2)„iFi(-n;-2n;2z), n G INq . (14.3-13) 

Together with some other, closely related polynomials, which are denoted by Uniz), the poly- 
nomials i^niz) are called Bessel polynomials. In Grosswald's book on Bessel polynomials [115] 
numerous applications of these polynomials in vastly differing fields are described. For instance, 
they are applied in number theory, in statistics, or for the analysis of complex electrical networks. 

In the context of convergence acceleration and summation it may be interesting to note that 
Bessel polynomials occur also in the theory of Fade approximants. In the book by Baker and 
Graves-Morris it is shown that the Fade approximants [i / m] for e^ are given by (see eq. (2.12) 
of part I of ref. [22]) 

i^/m] = AmGlNo. (14.3-14) 

iFi{—m;—l — m;—z) 

Comparison of eqs. (14.3-13) and (14.3-14) shows that the diagonal elements [n/n] of the Fade 
table for e^ can be expressed as ratios of Bessel polynomials, 

With the help of some well known monotonicity properties of the modified Bessel function of 
the second kind, K^{z), it can be shown that the reduced Bessel functions k^{z) are positive and 
bounded by their values at the origin provided that > and z > (see eq. (3.1) of ref. [114]). 
In the case of reduced Bessel functions with half-integral orders this implies: 

< K+i/2{z) < kn+i/2{0) = 2"(l/2)n, 0<2;<oo, nGlNo. (14.3-16) 

Grosswald's book [115] also contains a chapter on the asymptotic properties of Bessel polyno- 
mials. There, it is shown that for fixed and finite argument z the Bessel polynomials "dniz) satisfy 
(see p. 125 of ref. [115]) 

^n(^) ~ |^e% n^oo. (14.3-17) 

If we combine eqs. (14.3-13) and (14.3-17) we find that the dominant term of the Foincare-type 
asymptotic expansion in inverse powers of n of a reduced Bessel function kn+i/2iz) with fixed and 
finite argument z corresponds to its value at the origin, 

kn+i/2iz) = 2"(l/2)„[l + 0(n-i)] = fcn+i/2(0)[l + O(n-^)], n ^ oo . (14.3-18) 

Higher terms of the asymptotic expansion of a reduced Bessel function A;„+i/2(-z) in inverse 
powers of n can in principle be obtained from related expansions for Bessel polynomials yn{z). 
In Grosswald's book the coefficients for terms up to an order 0(n^'^) can be found (see p. 130 of 
ref. [115]) and in an article by Salzer [116] the coefficients for the terms up to an order 0(n^^). 

Starting from eq. (14.3-18) it can be proved quite easily with the help of eq. (14.3-9) that the 
terms of the infinite series (14.3-10) behave like vT^^'^ as n ^ oo (see p. 3709 of ref. [64]). In 
view of eqs. (7.3-12) and (7.3-14) this implies that the remainders of the partial sums of the series 
(14.3-10) behave like rT^I'^ as n — > oo. 



141 



Prom the series expansion (14.3-10) in terms of reduced Bessel functions another series of the 
same convergence type can be derived. The new series is essentially the 2;-independent part of 
the infinite series (14.3-10). If we take into account that fc_i/2(-z) = /z, we can conclude 
from eq. (14.3-12) that only the first term of the infinite series (14.3-10) is singular at the origin. 
Consequently, the following limit exists, 

oo 

lim [l/z - fc_i/2(^)] = lim V L-i/2(^)/[2"^m!] = 1, (14.3-19) 

m=l 

and we obtain with the help of eq. (14.3-16): 

f- (2^-1)" - 1 f- (V^)^ - 1 (143-20) 
^ (2m + 2)!! - 2 ^ (m + 1)! " li4.d 2Uj 

m=0 m=0 ^ ' 

Again, it follows from eq. (14.3-9) that the terms of this scries behave like n~^/^ as n ^ oo, 
which according to eqs. (7.3-12) and (7.3-14) implies that the remainders of this series behave 
like n~-^/^. 

Several sequence transformations are exact for the infinite series (14.3-20) since its partial sums 

satisfy the prerequisites of theorem 14-1. With the help of a summation theorem by Gauss for a 
hypergeometric series with unit argument (sec p. 40 of ref. [34]) it can be proved quite easily 
that the remainders of the infinite series (14.3-20) satisfy 



(^"^-1)" - (14 3-21) 

(2m + 2)!! - (n + 1)! ' ^'^"^ 

m=n+l ^ ' ^ ' 

which shows that the partial sums of the infinite series (14.3-20) are of the type of the sequence 
(14.2-7). Hence, it follows from theorem 14-1 that Levin's u transformation, eq. (7.3-5), will only 
need the partial sums s„, and s„-|-2 to be exact for the infinite series (14.3-20). Also, 
from eq. (10.3-4) it follows that Brezinski's algorithm, eq. (10.1-9), and its iteration J^^ , eq. 
(10.3-6), only need the partial sums s„, s„+i, s„+25 and s„_|_3 to be exact for the infinite series 
(14.3-20). 

Levin's v transformation, eq. (7.3-11), is even more efficient than the sequence transformations 
mentioned above because only the partial sums s^-i) ^n; a-^d s^+i are needed to sum the infinite 
series (14.3-20) exactly. This follows from the fact that in the case of the infinite series (14.3-20) 
the remainder estimate (7.3-10), which is the basis for the v transformation, 

an+ian _ 1 (l/2)„+i 



an+\ -a-n 3 (n-l- 1)! 

is proportional to the remainder (14.3-21) of the infinite series (14.3-20). Consequently, in this 
case the ratio (s„ — s)/ujn is independent of n which implies that (/3 -|- n)'^~^(s„ — s)/a;„ will be 
annihilated by A*^ for k > 1. 

The terms of the three test series (14.3-7), (14.3-10), and (14.3-20) all behave hke n"^/^ as 
n — > oo. Consequently, we may expect that these three series should be roughly comparable with 
respect to their rates of convergence as well as in convergence acceleration processes. However, 
at least in convergence acceleration processes these three test series are definitely not equivalent. 
The acceleration of the convergence of the series expansion (14.3-10) in terms of reduced Bessel 
functions is a much more formidable task, in particular for larger values of z, than the acceleration 
of the convergence of the other two series (14.3-7) and (14.3-20). In fact, for sufficiently large 



142 



values of z it is virtually impossible to accelerate the convergence of the infinite series (14.3-10). 
This is probably a consequence of the exponential decline of the terms and also of the partial 
sums of this series. Numerical tests showed that for larger values of 2; G IR-|- a reduced Bessel 
function is approximated by its value at the origin, 

^n+i/2(^) ~ fcn+i/2(0) = 2" (l/2)„ , n G INq , (14.3-23) 

with reasonable accuracy only if n is very large. For instance, if we require that eq. (14.3-23) 
should be accurate to one percent for 2 = 8 then we would need n > 1400, and for z = 4 we 
would still need n > 400. Consequently, in particular for larger values of ^ a partial sum ,s„ of the 
series (14.3-10) is essentially a linear combination of some quantities which decline exponentially, 
and only for relatively large values of n it can actually be observed that s„ behaves like n~^/^ as 
n — > oo. Thus, it is likely that for a sequence transformation, which tries to extract and utilize 
some regularity in the behaviour of the partial sums, the partial sums of the infinite series (14.3- 

10) appear for larger values of z to be much more irregular than the partial sums of the other two 
infinite series (14.3-7) and (14.3-20). 

14.4. Numerical examples 

In this section, the acceleration of logarithmically convergent sequences will be studied numer- 
ically. The emphasis will be on the test series (14.3-7), (14.3-10), and (14.3-20), which should 
converge approximately as slowly as the infinite series (1.1-2) for ^(3/2). But since the infinite 
series (14.3-1) for ^(2) is the most popular test problem for logarithmic convergence in the liter- 
ature, it is of interest to see how in particular the new sequence transformations fare if they are 
applied to the partial sums 

n 

Sn = XI ("^ + 1)'^ ' neSNo, (14.4-1) 

m=0 

of the infinite series (14.3-1) for C(2)- 

In table 14-1 the partial sums (14.4-1) are transformed by the standard form of wj^\ eq. (6.3- 
4), by A^"^(/3, s„), eq. (7.3-20), with /3 = 1, which corresponds to the special case x„ = l/{(3 + n) 

of the Richardson extrapolation scheme, eq. (6.1-5), and by J^^^\ eq. (10.3-6). In all cases, the 
approximants were chosen in such a way that the information, which is contained in the finite 
string sq, si, . . . , Sn of partial sums, is exploited in an optimal way. This means that in the case 
of yV^^\ eq. (6.3-4), the approximations to ("(2) were chosen according to eq. (6.3-9), and in the 

case of J^("\they were chosen according to eq. (10.4-7). 

All sequence transformations in table 14-1 accelerate the convergence of the infinite series (14.3- 
1) for ^(2) quite efficiently. The winner in table 14-1 is wj^\ eq. (6.3-4), which together with 
the standard form of Wynn's p algorithm, eq. (6.2-4), is the best accelerator for the series for 

C(2). Somewhat less efficient are A^"^(/3, s„), eq. (7.3-20), which in the case of the partial sums 

(n) 

(14.4-1) is identical with Levin's u transformation, eq. (7.3-5), and J'^ , eq. (10.3-6). 

Other good accelerators for the partial sums (14.4-1) are Levin's v transformation, eq. (7.3- 

11) , which is as efficient as Levin's u transformation, eq. (7.3-5), and Brezinski's -i? algorithm, eq. 

(10.1-9), and cr^\ eq. (11.2-2), which are almost as efficient as J'l^\ eq. (10.3-6). 

The partial sums and the three transforms in table 14-1 were computed in QUADRUPLE 
PRECISION (31 - 32 decimal digits). When these computations were repeated in DOUBLE 
PRECISION (15 - 16 decimal digits) the loss of some significant digits was observed. This is 
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Table 14-1 

Acceleration of the series (14.3-1) for C(2) = 7r^/6 



n 


partial sum 
eq. (14.4-1) 




eq. (6.3-4) 




An (l,So) 

eq. (7.3-20) 




^(n-.3ln/3l) 

eq. (10.3-6) 





1.0000000000000 


1 


.0000000000000 


1 


.0000000000000 


1, 


.0000000000000 


1 


1.2500000000000 


1 


.2500000000000 


1 


.5000000000000 


1, 


.2500000000000 


2 


1.3611111111111 


1 


.6500000000000 


1 


.6250000000000 


1, 


.3611111111111 


3 


1.4236111111111 


1 


.6468253968254 


1 


.6435185185185 


1, 


.6388888888889 


4 


1.4636111111111 


1 


.6449013949014 


1 


.6449652777778 


1, 


.6423611111111 


5 


1.4913888888889 


1 


.6449244489889 


1 


.6449513888889 


1, 


.6436111111111 


6 


1.5117970521542 


1 


.6449342449874 


1 


.6449351851852 


1, 


.6449225865209 


7 


1 5274220521542 


1 


.6449341126465 


1 


.6449339434186 


1 


.6449297924298 


8 


1.5397677311665 


1 


.6449340660297 


1 


.6449340411698 


1, 


.6449321959755 


9 


1.5497677311665 


1 


.6449340666548 


1 


.6449340662475 


1, 


.6449340557022 


10 


1.5580321939765 


1 


.6449340668515 


1 


.6449340671488 


1, 


.6449340629267 


11 


1.5649766384209 


1 


.6449340668489 


1 


.6449340668835 


1, 


.6449340652730 


12 


1.5708937981842 


1 


.6449340668482 


1 


.6449340668472 


1, 


.6449340668410 


13 


1.5759958390005 


1 


.6449340668482 


1 


.6449340668476 


1, 


.6449340668458 


14 


1.5804402834450 


1 


.6449340668482 


1 


.6449340668482 


1, 


.6449340668473 


15 


1.5843465334450 


1 


.6449340668482 


1 


.6449340668482 


1, 


.6449340668482 


7rV6 




1.6449340668482 


1.6449340668482 


1.6449340668482 



not surprising since the acceleration of logarithmic convergence is as emphasized previously - 
an inherently unstable process. Of the three sequence transformations in tabic 14-1 it was again 
y^k^\ eq. (6.3-4), which turned out to be the numerically most stable transformation since it lost 
at most 3 significant digits in DOUBLE PRECISION. The other two transformations, which lost 
up to 5 decimal digits, arc apparently more sensitive to rounding errors. 

Next, we want to see how the convergence of the test series (14.3-7), (14.3-10), and (14.3-20) 
can be accelerated. Since the remainders of these series behave like n~^/^ as n — > oo, we expect 
that these series will converge significantly more slowly than the series (14.3-1) for C(2), whose 
remainders arc of order 0{n~^). Here, it must be emphasized that it is not clear how and to 
what extent the slower convergence of the test series (14.3-7), (14.3-10), and (14.3-20) will affect 
convergence acceleration processes. 

First, we shall accelerate the convergence of the sequence of partial sums of the infinite series 
(14.3-7) for the lemniscate constant A, 



E 



- 1)!! 1 . . „N 

^ (14.4-2) 



(2m)!! 4m -1-1 

m=0 

In table 14-2 we see the effect of Levin's generalized sequence transformation (/3, s„, Un), eq. 
(7.1-8), with i = 2, ujn = CLn, and /5 = 1, of Levin's u transformation, eq. (7.3-5), with P = 1, and 
of J'lf'^ on the partial sums (14.4-2). As usual, the approximants were chosen in such a way that 
the information, which is contained in the finite string sq, si, . . . , s„ of partial sums, is exploited 
optimally. This means that in the case of the Levin transformations the approximations to the 
lemniscate constant A were chosen according to eq. (7.5-4). 
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Table 14-2 

Acceleration of the series (14.3-7) for the lemniscate constant A 



n 


partial sum s„ 
eq. (14.4-2) 


eq. (7.1-8) 




eq. (7.3-5) 


cq. (10.3-6) 


q 
o 


i . iOD ( UOiZoZUOi 


1 91 on/i 7R1 Qn/i 7R 


i 


.OiDoi/UOD ( O ( D 


1 '?n'?7n'i7n'?7n'?7 


A 

4 


i.ioi /oyOo/Uzo/ 


i.Oo4o4ZiDU0 / i / 


1 
i 


■^1 nfi797n7Qnf;'^ 


i.oUoUoD / oouuyy 





1 1 QQt^nC/l Q7nOQ7 

i.iyoOUo4c> /Uzo / 


i.oiUozyoyzoUzo 


1 
i 


.oiuyyozuuo/ (O 


i.c)uyozuuu ( uy / y 


D 


1 OnOi^'?1 S7/I ^9S7 
i .ZUZOoio ( 40Zo ( 


i.oiUoUoZiZozyo 


1 
i 


.oiiu/oyo/ ( y/D 


i.oiiUiiyD/4Ui4 


( 


1 onn7c^c;nfinc;7i c 
i.zuy < OoUDyo / 15 


1 qi 1 n0770C^71 1 7 


i 


.oiiUzyi4yyu<8 


1 Qi 1 noon7QnQi 
i.oiiuzzy / oyoio 


8 


1.2157059973061 


1.3110318476640 


1 


.3110287979182 


1.3110263202535 


9 


1.2207187157130 


1.3110290080304 


1 


.3110287737803 


1.3110287611468 


10 


1.2250162047862 


1.3110287461269 


1 


.3110287766205 


1.3110287718416 


11 


1.2287537180105 


1.3110287708982 


1 


.3110287771522 


1.3110287750875 


12 


1.2320431110268 


1.3110287771312 


1 


.3110287771540 


1.3110287771349 


13 


1.2349672811610 


1.3110287772480 


1 


.3110287771466 


1.3110287771425 


14 


1.2375891404731 


1.3110287771553 


1 


.3110287771460 


1.3110287771447 


15 


1.2399574101139 


1.3110287771452 


1 


.3110287771460 


1.3110287771461 


16 


1.2421104860230 


1.3110287771458 


1 


.3110287771461 


1.3110287771461 


17 


1.2440790912340 


1.3110287771461 


1 


.3110287771461 


1.3110287771461 


18 


1.2458881405432 


1.3110287771461 


1 


.3110287771461 


1.3110287771461 


[r(l/4)]V[4(27r)V2] 


1.3110287771461 


1.3110287771461 


1.3110287771461 



If we compare the results in tables 14-1 and 14-2, we see that the significantly slower convergence 
of the infinite series (14.3-7) does not affect the efficiency of convergence acceleration too much. 
The convergence of the transforms in table 14-2 is almost as fast as in table 14-1. However, 
it seems that the slower convergence of the test series (14.3-7) has a detrimental effect on the 
numerical stability of the transformations. As usual, table 14-2 was produced in QUADRUPLE 
PRECISION. When the same computations were repeated in DOUBLE PRECISION, a larger 
number of significant digits were lost than in table 14-1. The best results were obtained by Levin's 
u transformation which achieved a relative accuracy of 11 decimal digits after n = 11. For larger 
values of n, the accuracy deteriorated again. For instance, for n = 18 the best results were 
obtained by which achieved an accuracy of 8 decimal digits. 

If we compare eqs. (7.1-8) and (7.3-5), we find that Levin's u transformation may also be 
considered to be a special case of Levin's generalized sequence transformation jC,^^j{P, Sn,ujn), 

uP{/3,Sn) = /:g(/3,s„,a„). (14.4-3) 

This relationship shows that the numerical data in table 14-2 are in agreement with theorem 14- 
3 which predicts that the efficiency of Levin's generalized sequence transformation >C^"^^(/3, s„, a;„), 
eq. (7.1-8), for the acceleration of the convergence of sequences of the type of eq. (14.2-8) should 
decrease with increasing £ G IN. This behaviour is apparently quite typical since it was also 
observed when the partial sums of the test series (14.3-10) were accelerated by s„), eq. 

(7.3-5), and 4'5(/3, Sn, an), eq. (7.1-8), with £>2. 

Other good sequence transformations for the test series (14.3-7) are Levin's v transformation, 
eq. (7.3-11), which is as good or even slightly better than Levin's u transformation, eq. (7.3-5), 

and Brezinski's ■& algorithm, eq. (10.1-9), which is as good as C^^\{fi,Sn-,an)- 
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Theorem 14-4 predicts that A^" s„), eq. (7.3-20), which corresponds to the special case 
Xn = l/{f3 + n) of the Richardson extrapolation scheme, eq. (6.1-5), is not able to accelerate 
the convergence of the series (14.3-7), (14.3-10), and (14.3-20). Numerical tests confirmed this 
prediction. In addition, the standard forms of Wynn's p algorithm, eq. (6.2-4), and of its iteration 

yv'^\ eq. (6.3-4), also fail to accelerate the convergence of these series. Since the remainders of 
the test series mentioned above all behave like n"^/^ as n oo, and since the Richardson 
extrapolation scheme Af^^\sn,Xn), eq. (6.1-5), is by construction exact for the model sequence 
(6.1-6), it is an obvious idea to choose an alternative set of interpolation points according 
to 

x„ = (/J + n)-l/^ nGlNo, /? G IR+ . (14.4-4) 

Practical experience has shown that if the Richardson extrapolation scheme, eq. (6.1-5), can 
successfully handle a certain problem if the interpolation points {[a;„]} arc used, then the general 

forms of Wynn's p algorithm, cq. (6.2-2), and of its iteration W^"'^ eq. (6.3-3), arc usually able 
to handle the same problem if the interpolation points ^^n^ with ^„ = 1/xn are used. Hence, if 
we want to use these nonlinear sequence transformations for the acceleration of the convergence 
of the series (14.3-7), (14.3-10), and (14.3-20), we should choose the elements of the set {[^n]} of 
interpolation points according to 

= {P + n)^/\ nelNo, (3eJR+. (14.4-5) 



Table 14-3 

Acceleration of the series (14.3-7) for the lemniscate constant A 



n 


partial sum s„ 


Ari°)(5o,^o) 


(n-2ln/2l) 


^,(«-2[[n/2l) 




eq. (14.4-2) 


eq. (6.1-5) 


eq. (6.2-2) 


eq. (6.3-3) 






x„ = (n + l)-i/2 


6. = (n+l)V2 


^„ = (n + 1)1/2 


10 


1.2250162047862 


1.3110281470344 


1.3110287489950 


1.3110289097428 


11 


1.2287537180105 


1.3110291844571 


1.3110287903217 


1.3110290181070 


12 


1.2320431110268 


1.3110287720479 


1.3110287927338 


1.3110289480394 


13 


1.2349672811610 


1.3110287371888 


1.3110287908112 


1.3110286302938 


14 


1.2375891404731 


1.3110287841474 


1.3110287783445 


1.3110287340891 


15 


1.2399574101139 


1.3110287800479 


1.3110287774952 


1.3110287694697 


16 


1.2421104860230 


1.3110287759641 


1.3110287770923 


1.3110287666673 


17 


1.2440790912340 


1.3110287770396 


1.3110287771290 


1.3110287675098 


18 


1.2458881405432 


1.3110287772843 


1.3110287771523 


1.3110287670755 


19 


1.2475580797723 


1.3110287771349 


1.3110287771467 


1.3110287674918 


20 


1.2491058660392 


1.3110287771336 


1.3110287771459 


1.3110287670448 


21 


1.2505456974656 


1.3110287771492 


1.3110287771460 


1.3110287770066 


22 


1.2518895646423 


1.3110287771468 


1.3110287771461 


1.3110287770883 


23 


1.2531476731141 


1.3110287771456 


1.3110287771461 


1.3110287771050 


24 


1.2543287710802 


1.3110287771461 


1.3110287771461 


1.3110287770977 


25 


1.2554404064530 


1.3110287771461 


1.3110287771461 


1.3110287770960 


[r(l/4)]V[4(27r)V2] 


1.3110287771461 


1.3110287771461 


1.3110287771461 



In table 14-3 the partial sums (14.4-2) are accelerated by the Richardson extrapolation scheme, 
eq. (6.1-5), and by the general forms of Wynn's p algorithm, eq. (6.2-2), and oiW^\ eq. (6.3-3). 
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In the case of the Richardson extrapolation scheme the interpolation points were chosen 

according to eq. (14.4-4) with [3 = 1, and in the case of p^"^ and W^"^ the interpolation points 
{[^n]} were chosen according to eq. (14.4-5) with (3=1. 

The most efficient transformation in table 14-3 is the general form of Wynn's p algorithm, eq. 
(6.2-2), followed by the Richardson extrapolation scheme, eq. (6.1-5), and the general form of 
yyf \ eq. (6.3-3). However, a comparison of tables 14-2 and 14-3 shows that even if we choose 
the interpolation points according to eqs. (14.4-4) and (14.4-5), the transformations in table 14-3 

(n) 

are clearly less efficient than Levin's u transformation or J'j^ . 

As usual, table 14-3 was produced in QUADRUPLE PRECISION. When the same computa- 
tions were repeated in DOUBLE PRECISION, it was observed that the Richardson extrapolation 
scheme is much more unstable than the other two transformations. The Richardson extrapolation 
scheme achieved a relative accuracy of 8 decimal digits for n = 12. For larger values of n the 
accuracy of the transforms deteriorated rapidly, yielding totally nonsensical results for n > 22. 
The other two transformations also did not accomplish more than a relative accuracy of 7 or 8 
decimal digits. However, they maintained this relative accuracy throughout the whole range of n 
between n = 10 and n = 25. 

The results in table 14-3 and similar results for the other two test series (14.3-10) and (14.3- 
20) indicate that the Richardson extrapolation scheme, eq. (6.1-5), is able to accelerate the 
convergence of a sequence, whose remainders r„ behave like as n ^ oo, if the interpolation 

points are chosen according to eq. (14.4-4). Similarly, the general forms of Wynn's p 

algorithm, eq. (6.2-2), or of W^"'', eq. (6.3-3), should be able to accelerate the convergence of 
such a sequence if the interpolation points {[^n]} are chosen according to eq. (14.4-5). 

Unfortunately, in practical applications these observations arc not necessarily very helpful. Let 
us assume that only the numerical values of a few sequence elements are known but nothing about 
the behaviour of the remainders. In such a situation, it will be very hard or even impossible to 
find out whether the remainders of this sequence behave like an integral or like a nonintegral 
power of 1/n. If one wants to use the Richardson extrapolation scheme, eq. (6.1-5), in such an 
unfavourable situation, it may be a good idea to follow a recommendation by Beleznay [117]. He 
suggested to choose the interpolation points according to 

= {n + , n G INo , a, /3 G IR+ , (14.4-6) 

and to optimize the exponent a of the interpolation points in such a way that the error term 
^ I becomes minimal. This technique was later used by Liegener, Beleznay, and Ladik 
[118] to extrapolate the results of Hartree-Fock calculations on periodic chains. A similar approach 
is of course also possible in the case of the general forms of Wynn's p algorithm, eq. (6.2-2), or 

in) 

of its iteration , eq. (6.3-3). In that case, the interpolation points would have to be chosen 
according to 

= (n + /?)", nelNo, a,/?G]R+. (14.4-7) 

There is still another possibility of modifying either the Richardson extrapolation scheme, eq. 
(6.1-5), or the general forms of the rational transformations p^""*, eq. (6.2-2), and W^"'', eq. 
(6.3-3), in such a way that it will be unimportant whether the remainder of the sequence to be 
transformed behaves like an integral or a nonintegral power of 1/n. This approach is inspired by a 
nonlinear variant of the Richardson extrapolation scheme, which in Wimp's book is called GBW 
(Germain-Bonne Wimp) transformation (see p. 106 of ref. [23]). This GBW transformation is 
obtained from the Richardson extrapolation scheme by choosing the interpolation points according 
to 

Xn = As„ = a„+i , n G INo . (14.4-8) 
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If the interpolation points {[x„]} are chosen according to eq. (14.4-8), then it follows from eq. 
(6.1-6) that the Richardson extrapolation scheme, eq. (6.1-5), is exact for the following model 
sequence: 

k-l 

s„ = s + ^ [As„]^+^ , k,n eJNo, ^ G IR+ . (14.4-9) 

i=o 

According to Wimp this GBW transformation works quite well in the case of iteration sequences 
(see pp. 106 - 108 of ref. [23]). However, the GBW transformation is apparently not able to 
accelerate logarithmic convergence. 

Let us now assume that the remainders r„ of a sequence behave like as n ^ oo. Then it 
follows from eq. (14.2-2) that the product [nAs„_i] also behaves like n^" as n ^ oo. Hence, if 
we choose the interpolation points {[xn]} for the Richardson extrapolation scheme according to 

xn = (/? + n)As„_i, neJNo, /3 G 1R+ , (14.4-10) 

it is at least guaranteed that the interpolation points Xn behave like the as n — oo. 

If the interpolation points {[a;„]} are chosen according to eq. (14.4-10), then obviously the 
Richardson extrapolation scheme, eq. (6.1-5), is exact for the following model sequence: 

k-l 

Sn = s + ^Cj[{P + n)Asn-iy^\ fe, n G INq , PeJR+. (14.4-11) 

j=0 

It was remarked previously that if the Richardson extrapolation scheme, cq. (6.1-5), is able 
to handle a certain problem using the interpolation points {[a;„]}, then the extrapolation points 
{[^n]} with = should be used if the same problem is to be treated by the general forms of 
Wynn's p algorithm, eq. (6.2-2), and of its iteration yV^\ eq. (6.3-3). Hence, the appropriate 
interpolation points {[^n]} for p^^^ and would be 

= l/[{P + n)Asn-i], nGlNo, /3 G IR+ . (14.4-12) 

In table 14-4 the partial sums (14.4-2) are accelerated by the Richardson extrapolation scheme, 
eq. (6.1-5), and by the general forms of Wynn's p algorithm, eq. (6.2-2), and of its iteration 
>V^"\ eq. (6.3-3). In the case of the Richardson extrapolation scheme the interpolation points 

^Xn} were chosen according to eq. (14.4-10) with /? = 1, and in the case of p^f!'^ and ^ the 
interpolation points {[^n]} were chosen according to eq. (14.4-12) with (3 = 1. If we compare tables 
14-3 and 14-4, we find that the rate of convergence of the transforms is slower in table 14-4, but 
otherwise, the results are quite similar. 

As usual, table 14-4 was produced in QUADRUPLE PRECISION. When the same computation 
was repeated in DOUBLE PRECISION, it was again observed that the Richardson extrapolation 
scheme is much more sensitive to rounding errors than the other two transformations. For n = 15 
the Richardson extrapolation scheme achieved a relative accuracy of 6 decimal digits, and for 
larger values of n the accuracy deteriorated rapidly yielding nonsensical results for n > 22. Of the 
other two transformations in table 14-4, 'W^\ eq. (6.3-3), was this time the numerically more 
stable transformation. Wynn's p algorithm, eq. (6.2-2), achieved for n > 19 a relative accuracy 

for 7 decimal digits, whereas V\^]^\ eq. (6.3-3), achieved for n > 18 a relative accuracy of 8 
decimal digits. 

Next, the acceleration of the convergence of the other two test series (14.3-10) and (14.3-20) 
will be considered. The infinite series (14.3-20) may be considered to be a special case of the 
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Table 14-4 

Acceleration of the series (14.3-7) for the lemniscate constant A 



n 


partial sum Sn 


A/;l°Hso,xo) 


(r, 9[T^ /9ll^ 

in— /|ln/^j|j 
^2 In/21 


''^In/21 




eq. (14.4-2) 


eq. (6.1-5) 


eq. (6.2-2) 


eq. (6.3-3) 






Xn = {n + l)a„ 


= l/[(n + l)an] 


e„ = l/[(n + l)a„] 




i.ZZ0ulDZU4l: / oDZ 


i.oiUD ( ioo ( i041 


1 Q1 0871^71 QQ91 Q 

i.oiUo ( ( iyyziy 


1 1 1 Ofifif;Q7/l 71 R 


ii 


l.zzo/oo( ioUiUo 


1 Q1 00700/101 QQn 

i.oiuy ( uz4zioou 


1 Q1 1 OOfJQfiOOQQO 
1 .oi lUUDoDZUoyz 


1 Q1 1 0/10f571 fifi/IQ 


1 


1 9'?9n/i 1 1 noRS 

i./o/U4oiliUZDo 


i.oiiUoU ( oyoiDU 


1 Q 1 1 OOQKQi^OSO/l 
i.oiiUZyDoOUoU4 


1 "ii 1 0^0/1 f^l QfiQO 

i.oiiuoz40iyooy 


1 Q 


i.Zo4yD / ZoliOiU 


1 Q1 1 070l^l^^l^9/1f; 


1 ^1 1 O^OO/IQOI 

i.oiiuouu4yzioy 


1 Q1 1 0/1Q1 /I70SS/I 
i.oliU4yi4 / Uoo4 


1 /( 


1. ZO (Ooyi4U4 Mi 


1 Q1 1 OQQQfJC^I 1 07 


1 Qi 1 ooQ7(;f;c;oQO 


1 Q 1 1 OCCQI CiOOdl 


15 


1.2399574101139 


1.3110247934048 


1.3110284817234 


1.3110289425634 


16 


1.2421104860230 


1.3110247919628 


1.3110287561737 


1.3110288767162 


17 


1.2440790912340 


1.3110277629872 


1.3110287810924 


1.3110291518189 


18 


1.2458881405432 


1.3110291063652 


1.3110287803056 


1.3110289945504 


19 


1.2475580797723 


1.3110291052833 


1.3110287815108 


1.3110288722980 


20 


1.2491058660392 


1.3110288500150 


1.3110287770120 


1.3110288696319 


21 


1.2505456974656 


1.3110287479173 


1.3110287771445 


1.3110288718241 


22 


1.2518895646423 


1.3110287537771 


1.3110287771529 


1.3110288775601 


23 


1.2531476731141 


1.3110287734917 


1.3110287771494 


1.3110288714005 


24 


1.2543287710802 


1.3110287796054 


1.3110287771460 


1.3110288733834 


25 


1.2554404064530 


1.3110287785488 


1.3110287771461 


1.3110288715363 


[r(l/4)]V[4(27r)V2] 


1.3110287771461 


1.3110287771461 


1.3110287771461 



infinite series (14.3-10) since it was derived from it by performing the limit z — > 0. Because of eq. 
(14.3-18) we expect that these two series (14.3-10) and (14.3-20) should have roughly the same 
convergence properties. However, in convergence acceleration processes these two series differ 
significantly. As remarked previously, Levin's u and v transformation, eqs. (7.3-5) and (7.3-11), 

respectively, Brezinski's •& algorithm, eq. (10.1-9), and J^l^\ eq. (10.3-6), are all exact for the 
partial sums of the infinite series (14.3-20), whereas no sequence transformation is known which 
is exact for the sequence of partial sums 

n 

Sn = Y.^rn-i/2iz)/[2^m\], n G INq , ZGIR+, (14.4-13) 

m=0 

of the infinite series (14.3-10). In the case of those sequence transformations, which are not exact 
for the scries (14.3-20), it was observed quite consistently that the series expansion (14.3-20) 
can be accelerated more easily than the series expansion (14.3-10). Consequently, we shall not 
consider explicitly the acceleration of the convergence of the series (14.3-20). Instead, we shall 
focus our attention on the acceleration of the convergence of the infinite series (14.3-10) which is 
much more interesting in this context. The acceleration of the convergence of the series expansion 
(14.3-10) is particularly hard for larger values oi z. In fact, for sufficiently large values of z, every 
sequence transformation has so far been brought down to its knees. This strong dependence of 
the success of a convergence acceleration process on the the magnitude of the argument z make 
the series expansion (14.3-10) of l/z in terms of reduced Bessel functions a very interesting test 
problem. 

In table 14-5 the convergence of the partial sums (14.4-13) is accelerated by Brezinski's 
algorithm, eq. (10.1-9), by its iteration J^l"'\ eq. (10.3-6), and by A^"'^ eq. (11.2-1), with 
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Table 14-5 

Acceleration of the series expansion (14.3-10) for z = 4/5 



n 


partial sum s„ 
eq. (14.4-13) 




.(n-3[n/3l)x 

eq. (10.1-9) 


^{n-3[n/3l) 
^ In/31 

eq. (10.3-6) 


^{n-2[n/2l) 
^ In/21 

eq. (11.2-1) 


7 


1.0422312196170 


1 


.2497381860187 


1.2479931939358 


1.2173888687023 


8 


1.0550056275790 


1 


.2499224049805 


1.2494113420204 


1.2172621135266 


9 


1.0656857514131 


1 


.2497936062022 


1.2499952677367 


1.2015462070872 


10 


1.0747865667307 


1 


.2500104486053 


1.2499875622609 


1.2083962702181 


11 


1.0826618965033 


1 


.2500117160875 


1.2499952780892 


1.2511499315352 


12 


1.0895638413456 


1 


.2500026110013 


1.2499738050830 


1.2501603786137 


13 


1.0956774851981 


1 


.2500122711095 


1.2499996707633 


1.2500076445011 


14 


1 1011421634246 


1 


.2500120099841 


1 2499999749148 


1 2500005196325 


15 


1.1060650318428 


1 


.2500122009821 


1.2499999979586 


1.2500007343758 


16 


1.1105300244656 


1 


.2500168769473 


1.2500000006228 


1.2500006080295 


17 


1.1146039429560 


1 


.2500002080018 


1.2499999999894 


1.2500010863749 


18 


1.1183407028756 


1 


.2500032915285 


1.2499999999664 


1.2500008892374 


19 


1.1217843613599 


1 


.2500000030342 


1.2499999999776 


1.2499999946191 


20 


1.1249713188304 


1 


.2500000009966 


1.2499999999625 


1.2499999323380 


21 


1.1279319483516 


1 


.2500000107858 


1.2499999999720 


1.2499999648641 


22 


1.1306918204772 


1 


.2499999999866 


1.2500000000029 


1.2499999366280 


exact 




1.2500000000000 


1.2500000000000 


1.2500000000000 



/3 = 1. As in tables 14-1 and 14-2 ' has a slight plus over Brezinski's •& algorithm. The third 

transformation in table 14-5, A^"\ is clearly less efficient than the other two. 

As usual, table 14-5 was produced in QUADRUPLE PRECISION. When the same compu- 
tations were repeated in DOUBLE PRECISION, the loss of some significant digits was again 
observed. Relatively insensitive to rounding errors was , which for n = 22 reproduced 10 

in) 

decimal digits. For n = 22 Brezinski's i? algorithm reproduced 8 decimal digits, whereas A^. ' 
reproduced 7 decimal digits. 

If we compare the results produced by cq. (10.3-6), in tables 14-2 and 14-5 we see that 

the convergence of the series (14.3-7) for the lemniscate constant A can apparently be accelerated 
much more easily than the convergence of the series expansion (14.3-10) for 1/z in terms of reduced 
Bessel functions. Similar results were observed also in the case of other sequence transformations. 

The third sequence transformation in table 14-5, A^""*, eq. (11.2-1), was derived by modifying 

the recursive scheme (7.3-21) for A^"^(/5, s„) along the lines of Brezinski's -Q algorithm. There are 

some interesting differences between a[,"^ , which may be considered to be an iterated weighted 

process, and A^"^(/3, s„), which corresponds to the special = 1/ (/? + n) of the Richardson 

extrapolation scheme, with respect to their ability of accelerating logarithmic convergence. The 

linear sequence transformation A^"" •*(/?, s„) is one of the best accelerators for the series (14.3-1) for 
^(2) but according to theorem 14-4 is not able to accelerate the convergence of the test series (14.3- 

7), (14.3-10), and (14.3-20). The nonlinear sequence transformation a[,"^ is clearly less efficient 

than a["^(/3, Sn) in the case of the series for C(2)) but is at least moderately powerful in the 
case of the test series (14.3-7), (14.3-10), and (14.3-20). This example shows once more that the 
modification of the recursive scheme of a sequence transformation along the lines of Brezinski's 
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algorithm does not automatically lead to a sequence transformation which is able to outperform 
the transformation, from which it was derived, in all respects. However, it is quite likely that the 
new transformation will be more versatile than the transformation from which it was derived. 

The greater flexibility of those sequence transformations, which are derived along the lines of 
Brezinski's algorithm, is probably responsible for their ability of accelerating the convergence of 
the test series (14.3-7), (14.3-10), and (14.3-20), whose remainders all behave like n~'^l'^ as n ^ oo. 
A sequence transformation like the standard form of Wynn's p algorithm, eq. (6.2-4), is often able 
to achieve really spectacular results if the remainders of the sequence to be transformed behave 
like an integral power of 1/n, but it fails completely if the remainders behave like a nonintegral 
powers of 1/n. In such a case, the general form of Wynn's p algorithm, cq. (6.2-2), together with 
an appropriate set of interpolation points {[x„]} has to be used. However, one should not expect 
that it will always be an easy task to find an appropriate set of interpolation points {[x^]}. 



Table 14-6 

Acceleration of the series expansion (14.3-10) for z = 4/5 



n partial sum s„ n„ 

(1/2, so) >C}r^(l/2 £r(l/2 

eq. (14.4-13) eq. (7.3-5) eq. (7.1-7) eq. (7.1-7) 

u;n = {n+ 1)-V2 = (2n - l)!!/(2n)!! 



7 


1.0422312196170 


1, 


.2472807413200 


1.2500112144531 


1.2500305329006 


8 


1.0550056275790 


1, 


.2519888543148 


1.2499669957586 


1.2499700063760 


9 


1.0656857514131 


1, 


.2498098463228 


1.2500047257200 


1.2500032427111 


10 


1.0747865667307 


1, 


.2498185973113 


1.2500012644944 


1.2500013433652 


11 


1.0826618965033 


1, 


.2500735225247 


1.2499994685087 


1.2499995333305 


12 


1.0895638413456 


1, 


.2499966179905 


1.2500000284158 


1.2500000125919 


13 


1.0956774851981 


1, 


.2499942161928 


1.2500000253626 


1.2500000250149 


14 


1.1011421634246 


1, 


.2500019544458 


1.2499999930747 


1.2499999939416 


15 


1.1060650318428 


1, 


.2499999104639 


1.2500000000686 


1.2499999999124 


16 


1.1105300244656 


1, 


.2499998754938 


1.2500000003615 


1.2500000003511 


17 


1.1146039429560 


1, 


.2500000414919 


1.2499999999164 


1.2499999999261 


18 


1.1183407028756 


1, 


.2499999971441 


1.2499999999999 


1.2499999999984 


19 


1.1217843613599 


1, 


.2499999980000 


1.2500000000043 


1.2500000000042 


20 


1.1249713188304 


1, 


.2500000007366 


1.2499999999990 


1.2499999999991 


21 


1.1279319483516 


1, 


.2499999999235 


1.2500000000000 


1.2500000000000 


22 


1.1306918204772 


1, 


.2499999999760 


1.2500000000000 


1.2500000000000 


exact 




1.2500000000000 


1.2500000000000 


1.2500000000000 



If the convergence of a given sequence is to be accelerated by Levin's sequence transfor- 
mation C^^\(3, Sn,iOn)j cq. (7.1-7), together with one of the explicit remainder estimates (7.3-4), 
(7.3-6), (7.3-8), and (7.3-10), then the elements of the sequence {[s„]} also supply the remainder 
estimates {[wn]}- We can expect that Levin's sequence transformation will produce good results 
if the the remainder estimates {[wn]} can be chosen in such a way that the ratio (s„ — s)/tj„ will 
depend upon n only quite weakly, i.e., if it is a constant apart from terms, that are at least of 
order 0{n~^) as n — > oo or smaller. However, in practical applications it may happen that unless 
n is very large, the explicit remainder estimates (7.3-4), (7.3-6), (7.3-8), and (7.3-10) yield only 
relatively bad approximations for the actual remainders {[r„]| of the sequence to be transformed. 
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In such a case, it is to be expected that Levin's sequence transformation {f5, Sn,'jJn)-> eq- (7.1- 
7), will be a relatively weak sequence transformation if it uses one the the explicit remainder 
estimates (7.3-4), (7.3-6), (7.3-8), and (7.3-10). 

According to eq. (14.3-16) the reduced Bessel functions fcn+i/2(^) with z G IR+ and n G INq 
are positive and bounded by their values at the origin. However, it was already remarked in 
section 14.3 that due to the exponential decline of the reduced Bessel functions A;„_|_i/2(0) is a 

good approximation for A;„_|_i/2(-s) with a larger argument z only if n is relatively large. This has 
some unpleasant consequences if for instance Levin's u transformation, eq. (7.3-5), is to be used 
for an acceleration of the convergence of the series expansion (14.3-10) of 1/z in terms of reduced 
Bessel functions. For larger values of z the product {[3 + n) kn-i/2{z) with (3 G IR+ will be a good 
approximation for the remainder 

oo 

Tn = ^m-i/2(^)/[2"*rn!], nG ]No z G 1R+ , (14.4-14) 

m=n+l 

of the infinite series (14.3-10) only if n is very large. In such a situation, it should be worthwhile 
to look for other sets of remainder estimates {[a;„]} even if Levin's sequence transformation 

C^^\p, Sn,^n)-> eq. (7.1-7), would then be a linear sequence transformation. One simple possibility 
would be to choose 

a;„ = (n + l)-^/^ n G INq . (14.4-15) 

Another possibility, which would also lead to remainder estimates that behave like n^^f^ as 
n ^ cxD, would be to choose the remainder estimates according to eq. (14.3-21), 

Un = (2n- l)!!/(2n)!!, n G INq . (14.4-16) 

In table 14-6 the partial sums (14.4-13) are accelerated by u'^\l3,Sn), eq. (7.3-5), and by 

i2^"^(/3, s„, u;„), eq. (7.1-7), with either Un = (n + 1)^^/^ or u;„ = {2n — l)!!/(2n)!!. In ah cases 
(3 = 1/2 was used which gives slightly better results than P = 1. 

The results in table 14-6 show quite clearly that the remainder estimates (14.4-15) and (14.4- 
16) produce significantly better results than the remainder estimate (7.3-4) which is the basis 
of Levin's u transformation. There is indirect evidence that this improved convergence of the 
transforms is indeed due to the better approximation of the remainders (14.4-14) by the remainder 
estimates (14.4-15) and (14.4-16). If the convergence of the series (14.3-7) for the lemniscate 
constant A is accelerated by Levin's sequence transformation, eq. (7.1-7), with the remainder 
estimates being chosen according to eq. (14.4-15), then the results obtained in this way are as 
good or only marginally better than the results obtained by Levin's u transformation. Hence, in 
the case of the series (14.3-7) for the lemniscate constant A the remainder estimates (14.4-15) do 
not lead to a spectacular improvement. 

As usual, table 14-6 was produced in QUADRUPLE PRECISION. When the same computation 
was repeated in DOUBLE PRECISION, Levin's u transformation produced for n = 15 a relative 
accuracy of 8 decimal digits. The other two transformations produced also for n = 15 a relative 
accuracy of 10 decimal digits. For larger values of n, the accuracy deteriorated again. 
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15. Synopsis 

15.1. General considerations 

In this report a large number of mainly nonlinear sequence transformations for the acceleration 
of convergence and the summation of divergent series were discussed. Some of those sequence 
transformations as for instance Wynn's e algorithm are well established in the literature, while 
many others are new. The properties of these sequence transformations were analyzed and efficient 
algorithms for their evaluation were derived. In sections 13 and 14 the performance of these 
sequences transformations was tested by applying them to certain slowly convergent and divergent 
series, which are hopefully realistic models for a large part of the slowly convergent or divergent 
series that can occur in scientific problems and in applied mathematics. 

It still has to be discussed how one should actually proceed if the convergence of a slowly 
convergent sequence or series has to be accelerated or if a divergent series has to be summed. 
In view of the numerous different types of sequences and series, which can occur in practical 
problems, and because of the large number of sequence transformations, which are known, the 
selection of an appropriate sequence transformation is certainly a nontrivial problem. 

If the terms of the series, which is to be transformed, are known analytically or if it is known how 
the elements of the sequence {[sn]| of partial sums behave as n ^ oo, it is normally comparatively 
easy to find a suitable sequence transformation. Unfortunately, it can happen that only a few 
elements of a slowly convergent or divergent sequence {[sn]} are available and that the behaviour 
of the sequence elements s„ as n ^ cxd is not known. In such an unfavourable case, in which it 
is often not easy to decide whether {[sn]} converges at all, and if it docs, whether it converges 
linearly or logarithmically, the choice of an appropriate sequence transformation is by no means 
simple and also of decisive importance for the success of the whole approach. 

It is well known that the performance of a sequence transformation depends in most cases quite 
strongly upon the type of convergence of the sequence to which it is applied. Apparently, there is 
no sequence transformation which excells in every respect. Of all the sequence transformations in 
this report, only Levin's u transformation, eq. (7.3-5), to a somewhat lesser extent also Levin's 
V transformation, eq. (7.3-11), Brezinski's i? algorithm, eq. (10.1-9), and its iteration eq. 
(10.3-6), arc powerful accelerators for both linear and logarithmic convergence and arc also able 
to sum efficiently even wildly divergent series. In all test cases considered they were among the 
better sequence transformations. 

It is tempting to believe that it would be sufficient to use only the four sequence transformations 
mentioned above in situations, in which apart from the numerical values of a few sequence 
elements little is known. Since these sequence transformations are known to work well in a 
variety of different situations, it seems reasonable to expect that they will accomplish at least 
something. However, in many of the test problems of this report other, less versatile sequence 
transformations were actually more efficient. Hence, even if the four transformations mentioned 
above are successful, they do not necessarily give the best results, and it may well be worthwhile 
to look for other sequence transformations which are possibly more efficient, in particular if only 
relatively few sequence elements are available. 

There are also some other aspects which should be taken into consideration. In this report, 
only the most common types of sequences and series were considered, i.e., either linearly and 
logarithmically convergent sequences and series or alternating divergent series. This docs not 
exhaust all possibilities. Therefore, it is not certain whether the four sequence transformations 
mentioned above will also be able to handle successfully other types of convergence. For instance. 
Smith and Ford report that in the case of some slowly convergent series with terms having irregular 
sign patterns Wynn's e algorithm, eq. (4.2-1), clearly outperformed Levin's u transformation, eq. 
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(7.3-5), and Brezinski's -d algorithm, eq. (10.1-9), which both did not accomplish much (see table 
5 on p. 484 of ref. [30]). Also, in a situation, in which apart from the numerical values of 
only a few sequence elements very little is known, it is often not clear whether and how well the 
whole process has already converged. Even if a sequence transformation produces a sequence of 
transforms which apparently converges to some limit it cannot be excluded that this convergence 
is an artifact. If two different sequence transformations converge to the same limit, an artifact 
still cannot be ruled out but it is much less likely. Consequently, in such a situation it should be 
worthwhile to use more than a single sequence transformation. 

In the opinion of the author the approximate determination of the limit or antilimit s of a slowly 
convergent or divergent sequence is essentially an experimental problem which should be 

handled with utmost care. The numerical evidence supplied by a single sequence transformation 
is not necessarily sufficient, and it is usually a good idea to compare the results produced by 
several scqTicncc transformations. In order to facilitate the task of selecting appropriate sequence 
transformations, short resumes of the properties of all sequence transformations, which occur in 
this report, will now be be given. 

15.2. Wynn's epsilon algorithm and related transformations 

Wynn's e algorithm, eq. (4.2-1), and its close relative, Aitken's iterated process, eq. (5.1- 
15), are both able to accelerate linear convergence and to sum alternating divergent series even 
if they diverge as wildly as the Euler series, eq. (1.1-7), but they are not able to accelerate 

logarithmic convergence. 

Practical experience and also some theoretical estimates indicate that Wynn's e algorithm is 
only a moderately powerful sequence transformation, in particular if wildly divergent series must 
be summed. In the case of the two Sticltjcs scries (13.3-9) for the exponential integral and (13.4-3) 
for the logarithm, and also in other tests not discussed in this report, Wynn's e algorithm was not 
only clearly outperformed by Levin's sequence trctnsforination ^ {Pi ^n? uJn), eq. (7.1-7), and the 

new sequence transformations S^\/3, Sn,(jJn), eq. (8.2-7), and A^^"^(7, s„,a;„), eq. (9.2-6), but 
also frequently by Aitken's iterated algorithm, albeit to a lesser extent. 

On the basis of these results it looks as if Wynn's e algorithm should be dismissed. However, 
the real strength of Wynn's e algorithm is not its efficiency but its robustness. The e algorithm 
is remarkably insensitive to rounding errors and can also tolerate input data which either have a 
low relative accuracy or which behave in a comparatively irregular way. Due to its robustness, 
Wynn's e algorithm is often able to produce meaningful and reliable results in situations in which 
other sequence transformations, which are in principle much more powerful, fail. For instance, 
in ref. [64] the convergence of some infinite series with very complicated terms was accelerated 
by Wynn's e algorithm and by Levin's u transformation, eq. (7.3-5). Since these infinite series 
converge linearly, it was to be expected that Levin's u transformation would do better than 
Wynn's e algorithm. However, it was found that the e algorithm converged more rapidly than 
the u transformation. In addition, the e algorithm was apparently not affected by numerical 
instabilities whereas in the case of the u transformation a dangerous accumulation of rounding 
errors was observed (see pp. 3716 - 3717 of ref. [64]). 

Superficially, Aitken's iterated A^ process appears to be a better sequence transformation than 
Wynn's e algorithm. However, to a certain extent Aitken's iterated A^ process combines the 
disadvantageous features of both Wynn's e algorithm, which is only moderately powerful, and of 

the transformations C^^\/3 , Sn, ujn) , eq. (7.1-7), <S^"^(/3, s„, c<;„), eq. (8.2-7), and Al^"''(7, s„,a;„), 
eq. (9.2-6), which are not very robust since they are powerful sequence transformations only if 
the remainder estimates ^LOn^ are good approximations of the actual remainders ^Vn^. Experi- 
ence indicates that Aitken's iterated A^ process is in general less efficient than £j,"-*(/3, s„, a;„), 
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"^k (Pj ^n^'^n): and Alj^ (7, SnjWrt), and that it is less robust and more susceptible to rounding 
errors than Wynn's e algorithm. 

15.3. Wynn's rho algorithm and related transformations 

The properties of Wynn's e algorithm, eq. (4.2-1), and of Wynn's p algorithm, eq. (6.2-2), are 
complementary. The p algorithm is often a good or even very good accelerator for logarithmic 
convergence but is unable to accelerate linear convergence or to sum divergent series. But with 
respect to robustness, the e and the p algorithm are very similar. Experience indicates that the p 
algorithm is in general less sensitive to rounding errors than other sequence transformations which 
are also able to accelerate logarithmic convergence. This is certainly no mean accomplishment, 
in particular since the acceleration of logarithmic convergence is an inherently unstable process. 

The power of Wynn's p algorithm, which is essentially an intelligent way of computing and 
extrapolating to infinity an interpolating rational function of the type of eq. (6.2-1), depends 
decisively upon an appropriate choice of the interpolation points In this respect, the p 

algorithm closely resembles the Richardson extrapolation scheme, eq. (6.1-5), which is essentially 
an efficient way of computing and extrapolating to zero an interpolating polynomial of the type of 
eq. (6.1-3). According to theorem 14-4 the linear sequence transformation a[,"^(/3, s„), eq. (7.3- 
20), which corresponds to the special case x„ = l/{P + n) of the Richardson extrapolation scheme, 
eq. (6.1-5), is only able to accelerate the convergence of logarithmically convergent sequences if 
the remainders of these sequences behave like integral powers of 1/n as n ^ 00. 

The standard form of Wynn's p algorithm, eq. (6.2-4), which corresponds to the choice Xn = 
(3 + n ioi the interpolation points in eq. (6.2-2), is a very powerful accelerator for logarithmically 
convergent sequences with remainders that behave like integral powers of 1/n as n 00. However, 
experience indicates that the standard form of the p algorithm is unable to accelerate convergence 
if the remainders of the sequence to be transformed behave like a nonintegral power of 1/n. In 
section 14.4 it was shown that the general form of Wynn's p algorithm, eq. (6.2-2), is apparently 
able to accelerate the convergence of sequences with remainders that behave like n~^/^ as n ^ 00 
if the interpolation points {[a;„]} arc chosen in such a way that x„ ~ n-^/^ as n ^ cxd. 

The iterated sequence transformation eq. (6.3-3), is also only able to accelerate loga- 

(n) 

rithmic convergence. The power of Wf' depends as in the case of Wynn's p algorithm, from 
which it was derived, strongly upon an appropriate choice of the interpolation points {[x^]}-. The 

(n) 

numerical results presented in section 14.4 indicate that Wj^ has similar properties as Wynn's 

p algorithm. The standard form of eq. (6.3-4), is apparently not able to accelerate the 

convergence of sequences whose remainders behave like nonintegral powers of 1/n. However, the 

results in section 14.4 also show that the general form of W^"\ eq. (6.3-3), is apparently able to 
accelerate the convergence of sequences with remainders that behave like n~^/^ as n — >■ 00 if the 
interpolation points {[xn]} are chosen in such a way that x„ ~ n^/^ as n — 00. It also seems that 

(n) 

is relatively insensitive to rounding errors. However, because of the limited experience with 
this transformation it seems to be too early for a definite assessment of its merits as well as its 
weaknesses. Further tests of this sequence transformation should therefore be of interest. 

(n) 

The fact, that Wynn's p algorithm and its iteration are only successful if an appropriate 

set of interpolation points is used, severely limits the practical usefulness of these transformations 
in situations in which only the numerical values of a few sequence elements are known. In such a 
situation, it may be a good idea to use a modification of a suggestion by Beleznay [117]. In this 
approach, the interpolation points are chosen according to eq. (14.4-7) and the free parameter 
a is optimized after the input of every new sequence s„. Another possibility would be to choose 
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the interpolation points according to eq. (14.4-12). However, these two suggestions are not yet 
sufficiently tested and it seems to be too early for a definite assessment of their practical usefulness. 

15.4. Levin's sequence transformation and related transformations 

It is a typical feature of Levin's sequence transformations s„, a;„), eq. (7.1-7), and of 

the related transformations sj, \f3, Sn,i-L>n), eq. (8.2-7), and xi"^(7, uJn), eq. (9.2-6), that 
they not only require the sequence elements s„, s„+i, . . . , Sn+k, but also the remainder estimates 
uJn,0Jn+i, ■ ■ ■ This explicit incorporation of remainder estimates is both the strength as 

well as the weakness of these sequence transformations. If it is possible to find a sequence of 
remainder estimates that are good approximations of the remainders {[r„]} of the sequence to 

be transformed, then experience as well as some theoretical estimates indicate that such a sequence 
transformation is extremely powerful. If, however, a good sequence of remainder estimates cannot 
be found, such a sequence transformation will probably perform quite poorly. 

Theoretical estimates as well as practical experience indicate that the remainder estimates 
•{[aJ„]} should be chosen in such a way that the ratios (s^ — s)/ujn depend on n only quite weakly 
and approach a constant as n — > co. In practical applications Levin's sequence transformation 
Sfn '^n) has so far exclusively been used in connection with the simple remainder estimates 
(7.3-4), (7.3-6), (7.3-8), and (7.3-10), which can also be used in the case of the new transforma- 
tions S^\l3^ Sn^o^n) and Al[."'^(7, s„,a;„). The remainder estimate (7.3-4) gives Levin's u trans- 
formation, eq. (7.3-5), which is certainly one of the most powerful and most versatile sequence 
transformations. It is a powerful accelerator for both linear and logarithmic convergence and is 
able to sum efficiently divergent alternating scries. The remainder estimates (7.3-6) and (7.3-8) 
give Levin's t and d transformations, eqs. (7.3-7) and (7.3-9), respectively, which are powerful 
accelerators for linear convergence and are able to sum efficiently divergent alternating series. 
However, they are unable to accelerate logarithmic convergence. The remainder estimate (7.3-10) 
gives Levin's v transformation, eq. (7.3-11), which has similar properties as Levin's u transfor- 
mation. Finally, the remainder estimate = \/{(3 + n) gives the linear sequence transformation 
Al"^(/3,Sn), eq. (7.3-20), which can also be obtained from the Richardson extrapolation scheme, 
eq. (6.1-5), by choosing = 1/ (/3 -|- n) . It is able to accelerate logarithmic convergence if the 
remainders of the sequence to be transformed behave like an integral power of 1/n as n — > oo. 

The simple remainder estimates (7.3-4), (7.3-6), (7.3-8), and (7.3-10) are essentially asymptotic 
in nature because they were derived using some simplifications which are valid for large values of 
n. However, in convergence acceleration or summation processes it is tried to approximate the 
limit or antilimit of a sequence {[sn]} using only the information stored in the first few sequence 
elements, say sq, si, . . . , Sm-, with m being a relatively small number. Therefore, it is by no means 
clear whether the simple remainder estimates (7.3-4), (7.3-6), (7.3-8), and (7.3-10) lead to good 
approximations of the actual remainders for only moderately large or even small indices. 

There is some evidence that the simple remainder estimates (7.3-4), (7.3-6), (7.3-8), and (7.3-10) 
lead to efficient sequence transformations if the terms of the series, which is to be accelerated 
or summed, approach their asymptotic limits relatively fast. Let us for instance assume that 
a„ is the term of a power series in z and that a„ behaves like n^z" as n ^ oo. Then, the 
sequence transformations C^^\fi, Sn,ujn), S^\p, Sn,iOn), and A4[,"^(7, Sn,(^n) should work well in 
combination with one of the simple remainder estimates (7.3-4), (7.3-6), (7.3-8), and (7.3-10) if 
the leading term n"z" is a good approximation for already for moderately large or even small 
values of n. If this is not the case, the simple remainder estimates (7.3-4), (7.3-6), (7.3-8), and 
(7.3-10) will probably not work particularly well. 

The infinite series (14.3-10) is a good example for the complications which can occur in this 
context. It was remarked earlier that the reduced Bessel functions, eq. (14.3-11), approach their 
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asymptotic limits according to eq. (14.3-18) quite slowly. This slow approach decreases the 
efficiency of Levin's u transformation, cq. (7.3-5), considerably. The results presented in table 
14-6 show that in this case it is advantageous to use other, explicit remainder estimates, which are 
not obtained from the elements of the sequence {[s^]} to be transformed, even if Levin's sequence 
transformation is then a linear sequence transformation. Unfortunately, such an approach is only 
possible if the remainders are known analytically and if simple and yet good approximations for 
the remainders can be derived. 

Also, under unfavourable circumstances the simple remainder estimates (7.3-4), (7.3-6), (7.3- 
8), and (7.3-10) may have a detrimental effect on the robustness of the sequence transformations 

4")(/3,,s„,.;„),4")(/3, "5?!, W„ ), and M^^\^, Sn,oJn)- The elements of the sequence are not 

only input data, but they are also used to compute the remainder estimates Consequently, 
the elements of {[sn]} induce two fundamentally different kinds of errors. More or less inevitable are 
the errors due to the limited accuracy of the input data. However, the elements of the sequence 
{[sn]| induce also potentially large errors among the remainder estimates {[wn]}, either because 
they are not accurate enough or because they deviate too much from their asymptotic limits and 
therefore produce bad remainder estimates. The worst scenario, which can be imagined in this 
context, would be that the terms a„ of a series are not very accurate and that the terms approach 
their limiting expressions only quite slowly and in an irregular fashion. In such a situation the 
sequence transformations C^f^\(3, Sn,LOn), sj^\p, Sn,i-^n), and 7W^"''(7, ,s„, ci;„) will be in trouble 
and it is likely that Wynn's e algorithm, although in principle only moderately powerful, will 
produce better results. 

Levin's sequence transformation £^"'^(/3, s„, a;„), cq. (7.1-7), is based upon the assumption 
that the ratio (s„ — s)/ujn can be approximated by a polynomial in l/(/3 -|- n), whereas the 

new sequence transformations S^\p, Sn,LOn), cq. (8.2-7), and A^^"'^(7, s„,a;„), eq. (9.2-6), 
were derived assuming that the ratio (s„ — s)/(jJn can be approximated by truncated factorial 
series or related expressions. Since power series and factorial series have different properties, 
it is not surprising that the new sequence transformations and Levin's transformation behave 
differently in convergence acceleration and summation processes. With respect to the acceleration 
of linear convergence the new sequence transformations sj^\p, Sn,tOn) and M^^\'y, Sn,u}n) are 
approximately as efficient as Levin's sequence transformation. The new sequence transformations 
are particularly well suited to sum wildly divergent alternating series such as the Eulcr series, 
eq. (1.1-7). In that respect, they are usually at least as good as Levin's sequence transformation 
and often they are even clearly better. However, the new transformations perform quite poorly 

if logarithmic convergence is to be accelerated. Also, the linear transformations Tj^\a, Sn), eq. 

(8.4-11), andP^"^(7,s„), eq.(9.4-ll), are much less efficient than their analogue A^"'^(7, s^), eq. 
(7.3-20). 

The stability properties of the sequence transformations >c[,"^(/3, .s„, aj„), sj^\(3, Sn,iOn), and 

LUn) depend very much upon the sequence which is to be transformed and upon 
the remainder estimates being used. However, at least some statements of a more general 
nature, which are based upon experience, can be made. It seems that the transformation of 
both convergent and divergent alternating series is in general remarkably stable. Also, the 
acceleration of linear convergence usually poses no particular stability problems. The acceleration 
of logarithmic convergence is always a problem which may easily lead to a serious loss of accuracy. 
But it cannot be said that Levin's sequence transformation is more sensitive to rounding errors 
than most other sequence transformations. Also, it is probably safe to say that the sequence 

transformations C^^\p, Sn,tdn), 'Sj^^\p, Sn,'^n)j and A^^""* (7, Snj "^n) are in general more efficient 
and at the same time less robust than Wynn's e algorithm if linear convergence is accelerated or 
if divergent alternating series are summed. In the same way, Wynn's p algorithm is apparently 



157 



more robust than the u and v transformation or the hnear sequence transformation A^" s„) in 
the case of logarithmic convergence. 

Finahy, there is Drummond's sequence transformation T>^\sn,ujn), eq. (9.5-4), which is an- 
other relative of Levin's sequence transformation since it also uses a sequence of remainder esti- 
mates {[ci^n]}. Drummond's sequence transformation is very important theoretically, in particular in 
connection with Germain-Bonne's formal theory of convergence acceleration [33] and the explicit 
construction of Fade approximants for the Euler series, eq. (1.1-7). However, in practical appli- 
cations Drummond's sequence transformations is at most moderately powerful. It is significantly 
less powerful than the sequence transformations Z!^"''*(/3, s„,a;„), eq. (7.1-7), 5^"''*(/3, s„,a;„), eq. 
(8.2-7), and M'-^\^, uon), eq. (9.2-6), but has the same weaknesses as these transformations. 

15.5. Brezinski's theta algorithm and related transformations 

Brezinski's •& algorithm, eq. (10.1-9), and its iteration J'l^^\ eq. (10.3-6), combine many of the 
advantageous features of Wynn's e algorithm, eq. (4.2-1), and of Wynn's p algorithm, eq. (6.2-2). 
They are able to accelerate linear convergence and to sum even wildly divergent alternating series, 
and they are also able to accelerate logarithmic convergence. 

In those tests, in which linear convergence had to be accelerated or divergent alternating series 

(n) 

had to be summed, Brezinski's •& algorithm and its iteration were usually better than the 
e algorithm, but less powerful than the sequence transformations C^^\p,Sn,0Jn), eq. (7.1-7), 

S^^\p,sn,u;n), eq. (8.2-7), and M^^\j, Sn,u;n), eq. (9.2-6). 

With respect to the acceleration of logarithmic convergence Brezinski's algorithm and its 
iteration J'^"'^ are more reliable than the standard form of Wynn's p algorithm, eq. (6.2-4), since 
they are not restricted to sequences with remainders that behave like an integral power of 1/n 
as n ^ oo, and they are easier to use than the general form of Wynn's p algorithm, eq. (6.2-2), 
since no interpolation points are needed. In those tests, in which logarithmic convergence had to 
be accelerated, they were approximately as powerful as Levin's u and v transformations. 

It also seems that with respect to numerical stability and robustness Brezinski's i? algorithm 

(n) 

and its iteration ' are less robust than the e or the p algorithm and also more susceptible to 

rounding errors. 

The other sequence transformations, which were also derived along the lines of Brezinski's i? 
algorithm are B^^\ eq. (11.1-5), eq. (11.1-12), aJ."\ eq. (11.2-1), af^ , eq. (11.2-2), and 

eq. (11.2-3). It is a typical feature of these transformations that they are much more 
versatile than the transformations from which they were derived. This means they are all able 
to accelerate linear and logarithmic convergence and are also able to sum even wildly divergent 
alternating series. 

Unfortunately, it is also a typical feature of these sequence transformations that their perfor- 
mance in the numerical tests described in sections 13 and 14 was quite inconsistent and more 
or less unpredictable. For instance, o"^ turned out to be a very powerful accelerator for the 
infinite series (14.3-1) for C(2), a powerful accelerator for the infinite series (14.3-20), but a rel- 
atively weak accelerator for the infinite series (14.3-7) and (14.3-10). No explanation for this 
inconsistent behaviour can be given. At best, the sequence transformations listed above were as 

(n) 

good as Brezinski's -Q algorithm or its iteration , but in most cases they were significantly 
weaker. Also, it seems that the sequence transformations mentioned above are not more robust 
and less susceptible to rounding errors than the d algorithm or J^, ' . Hence, it seems that the 
most promising choices among all sequence transformations, which were derived along the lines 
of Brezinski's "Q algorithm, are the ■& algorithm, eq. (10.1-9), and J^^^ ■, eq. (10.3-6). 
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